قالب وردپرس درنا توس
Home / Technology / This WWDC Third-Year Fellow has built an ML model to recognize beer in one day

This WWDC Third-Year Fellow has built an ML model to recognize beer in one day



Every year, Apple invites student developers to its Worldwide Developer Conference. This year 350 fellows were present. This afternoon, I met Collin DeWaters from Fredericksburg, Virginia, who already has four tracks on the App Store and put together a new 3D racing game for his Swift Playground application in three days. He is 21.

WWDC Fellow Collin DeWaters

Student Wonders are everywhere on the WWDC. I competed against two at today's Nike Run Club. But even from high-level WWDC fellowship standards, DeWaters seems to be extraordinarily versatile in its interests and familiarity with Apple's APIs.

While traveling as an Apple guest during the event – including a trip Steve Jobs Theater from Apple Park met with Tim Cook – DeWaters found time to create prototype code using the latest APIs released. He also made a stop at Apple's Infinite Loop Store to find the recently announced Pride Month Band for Apple Watch. And during the WWDC week, he appeared on AltConf (his interview is on YouTube).

A Fast Learner

DeWaters became interested in computers that initially worked with PCs, but then bought a Mac in high school for a few years to figure out Apple's Objective-C development language.

In 2014, Apple released Swift, and DeWaters quickly became a fan of the new language. He found that it was easy to understand, easier to learn and easier to read and work with code, especially when compared to ObjC. In 2015, he launched his first App Store title "Avoid," a game in which players dodge and defend against floating blips to stay alive for as long as possible.

This year he also applied for a WWDC scholarship, but was not accepted. That did not stop him. He founded a social network for music and won a scholarship in 2016. The next year he worked with SpriteKit and GamePlay Kit to build the retro 2D game Bit Hockey, which he submitted as Swift Playground and was re-invited to WWDC.

This year, he applied for his latest project, a 3D racing game, with the intention of adapting it to work with ARKit. He's actually written the game twice: first as a conventional racing game for Mac driving a car around a track (there are billboards in the game cleverly promoting its other software titles), and again as an iOS game to put it into practice an Augmented Reality title where players control the spin speed of hot-wheeled cars driving on a horizontal route recognized by ARKit.

DeWaters has written down most of its GameKit and SceneKit logic in the game. The game was easy to port between Macs and iOS. However, the two platforms require more custom work when creating their platform-native UI. He explained that UIKit on iOS made the creation of UI elements relatively easy and was much easier to understand compared to the Mac AppKit API.

One of the new features that Apple demonstrated this year was an internal effort to host its own UIKit-based apps on the Mac in MacOS Mojave, including News, Stocks, Home, and Voice Memos. Each of the apps has a simple interface that easily adapts to the mouse and window interface of the Mac without having to rewrite it in macOS AppKit APIs.

Next year, after Apple has optimized its implementation of UIKit on macOS, it is expected that this work will be released to third-party developers. DeWaters noted that this would make it easier to move your own iOS games (and other apps with a simple interface) to the Mac.

Music Memories

DeWaters was proud of Music Memories. With this original app, users can select photos taken at specific dates, select a calendar event or selected date range, and then propose (using MusicKit) the user-owned songs (machine learning and some original algorithms) and create a Zeitgeist playlist Can be accessed anywhere Apple Music works.

Once a music store has been created, the title playlist will appear on iOS devices, Apple Watch, your Mac, and may even be requested by Siri to play on HomePod.

The creative title (a free app) was recently introduced by Apple on the App Store and jumped to 1,000 users daily. It is already available worldwide but currently limited to English. DeWaters said he was attending sessions at WWDC with an interest in localizing it for other speakers and places.

He also plans to release a 2.0 version that uses a subscription model that offers both a Mac version of the app and the ability to save reminders in the cloud. The app store reports glow, and one user writes, "I love using this app specifically with the & # 39; dynamic reminders!" I could listen to a playlist of music from college 3 years ago! The fact that it all works The integrated music app makes this app a real gem. "

Mojave MacBook Pro, with Touch Bar

DeWaters has already used the new macOS Mojave on his MacBook Pro. He assured me that he would boot it twice, but also said that the new developer version is already very useful. I asked what he thought about the new Dark IU. "I'll never turn it off, I love it!" he said.

I asked him about the Touch Bar on his MacBook Pro. Did he find it useful? It turns out that he has already created apps that use it. His iOS Bit Hockey game started on the Mac, where he used the Touch Bar APIs to provide menu shortcuts and pause the game.

He also said that he finds his touch bar in other apps, including Apple's Xcode development tools, where he can comment on a variety of code with a single touch of the touch bar, possibly isolating a problem.

What else does he expect from Apple? Well, the rumors revolve around glasses that have an augmented reality experience for AR, without having to show a phone. Maybe until 2020.

ML Beer

DeWaters already has a lot to think about. He somehow found time to work with Apple's newly-created Create ML to create a machine learning model.

Yesterday (!) During the AltConf (meeting around the corner of WWDC), he unpacked a machine learning model to recognize drinks and see if a photo or camera image was water, wine, beer, or any other beverage ,

He made 400 photos of human drinks and created a model in ten minutes, which he demonstrates for me by looking at picture search photos.

"That's wine," he pointed out. "And here's a beer," he said as his demo app labeled drinks in pictures as he pointed his camera at her, first with a confidence predictor and then with a pinned 3D tag floating in the room. It seems to be a free ARKit. Speaking of beer: This year, DeWater's third is WWDC, but tomorrow will be his first WWDC bash, where he's old enough to get an armband for adult drinks.

Beers everywhere.


Source link