Progress
What we have built, by date
The main features are built and running on real phones. We are now tuning them. This page is taken from our own commit history.
Log
The road so far
Masking model retrained on real screens
Retrained the on-device model that masks personal information, this time with real phone screens and paired counter-examples in the training data. On held-out real screens it now catches 99.3% of personal details, up from 92.8%, with fewer than half the false masks. This website and our GitHub organization went public the same day.
First full lint pass
Ran the static checks over the whole app for the first time. 28 errors found and fixed. Moved file and database work off the main thread in search and the folder view.
Masking that reads context
A clinic's phone number, an order number or a date is not personal information. Added rules that look at the surrounding words before masking.
The character learns 19 new moves
The 3D character can now turn its ring and head a full circle. It has 30 short animations in all, and a flat version for phones that can't run 3D.
Sharing with family, and watching for things
The person can share text, photos and files to family from any app. PalmCore can watch for a notification in the background and act on it when it arrives. Map cards in conversation.
Family app
A second app for family members. Pairing by QR code or invite link, messages encrypted end to end, live screen sharing that starts only after the person agrees on their own phone.
Interface rebuilt around the character
The character became the home screen, with the conversation in a glass panel beneath it. Speech recognition and speech output can each run on the phone or in the cloud.
It can operate the phone for you
PalmCore reads the screen and carries out a task one step at a time, saying what it is pressing. Anything that can't be undone needs a yes first.
Privacy on the phone
On-device masking for text and for photos such as medicine bags. A background guard that notices suspicious messages.
Second version begins
The first version proved the idea. We started over on the parts that needed it, aiming at something that holds up in daily use.
First version and film finished
A complete first version of the app, the 3D character, and a two-minute film showing it in use.
Work begins
First designs and the first code.
Part of the source is public at github.com/OmniCore-lab.
What's left
What is left before release
- TuningAccuracy of the masking model on the phone itself, speed on older phones, and the small things that only show up in daily use.
- Family app on iPhoneWritten. Still to be compiled and tested on a device. The Android family app works.
- Outside verificationOur measurements are our own. We want someone outside the team to check them.
- Public releaseAfter tuning. No date yet.