Thanks! Between my friends and I, it&#x27;s about a 50&#x2F;50 split between local and cloud. I think it&#x27;s great to be able to pick the tradeoff between quality&#x2F;privacy based on your own privacy preferences.

I&#x27;d only ever consider doing it with a local model, but this looks really cool!

That would be really cool, but for the foreseeable future there&#x27;s still a lot of room to improve how screen data is used so I&#x27;ll mostly be focused on that.

Is it possible to include wearables as a data sources?i.e. apple watch for sleep, running, activity levels? it could really give a 360 view of your life

Recall (and Rewind) are similar in the sense that they both use screen data, but it&#x27;s designed for retrieving specific things you saw, not semantically summarizing your time. My opinion is that they&#x27;re completely different feature sets.

wait... isnt this pretty much what Microsoft was doing with Recall?

Hi HN! I&#x27;ve been building Dayflow, a macOS app that automatically tracks what you&#x27;re actually working on (not just which apps you have open).Here&#x27;s what it does:- It creates a semantic timeline of your day;- It does it by understanding the content on your screen (with local or cloud VLMs);- This allows you to see exactly where your time went without any manual logging.Traditional time trackers tell you &quot;3 hours in Chrome&quot; which is not very helpful. Dayflow actually understands if you&#x27;re reading documentation, debugging code, or scrolling HN. Instead of &quot;Chrome: 3 hours&quot;, you get &quot;Reviewed PR comments: 45min&quot;, &quot;Read HN thread about Rust: 20min&quot;, &quot;Debugged auth flow: 1.5hr&quot;.I was an early Rewind user but rarely used the retrieval feature. I built Dayflow because I saw other interesting uses for screen data. I find that it helps me stay on track while working - I check it every few hours and make sure I’m spending my time the way I intended - if I’m not, I try to course correct.Here’s what you need to know about privacy:- Run 100% locally using qwen2.5-vl-3b (~4GB model)- No cloud uploads, no account- Full source available under MIT license (<a href="https:&#x2F;&#x2F;github.com&#x2F;JerryZLiu&#x2F;Dayflow" rel="nofollow">https:&#x2F;&#x2F;github.com&#x2F;JerryZLiu&#x2F;Dayflow</a>)- Optional: BYO Gemini API key for better quality (stored in Keychain, with free-tier workaround to prevent training on your data)The tech stack is pretty simple, SwiftUI with a local sqlite DB. Uses native macOS apis for efficient screen captures. Since most people who run LLMs locally already have their tool of choice (Ollama, LLMStudio, etc.), I decided to not embed an LLM into Dayflow.By far the biggest challenge was adapting from SOTA vision models like Gemini 2.5 Pro to small, local models. My constraints were that it had to take up &lt;4GB of ram and have vision capabilities. I had to do a lot of evals to figure out that Qwen2.5VL-3B was the best balance of size and quality, but there was still a sizable tradeoff in quality that I had to accept. I also got creative with sampling rates and prompt chunking to deal with the 100x smaller context window. Processing a 15 minute segment takes ~32 local LLM calls vs 2 Gemini calls!Here’s what I’m working on next:Distillation: Using Gemini&#x27;s high-quality outputs as training data to teach a local model the patterns it needs, hopefully closing the quality gap.Custom dashboards where you can track answers to any question like &quot;How long did I spend on HN?&quot; or &quot;Hours until my first deep work session of the dayI&#x27;d love to hear your thoughts, especially if you&#x27;ve struggled with productivity tracking or have ideas for what you&#x27;d want from a tool like this.

Show HN: Dayflow – A git log for your day