Where did you get a large dataset of handwritten maths? I have been looking for such a thing, and I have a lot of my own, but that's just one person's handwriting.
I have had a lot of success recently using the open-weight Qwen2.5-VL-7B through Ollama to convert hundreds of handwritten slides to Latex. Plenty of manual work still needed though.
Is it possible to ad a whiteboard to draw simple formulas?
It requires a Google account. Is it possible to show a precalculated result for the examples? (I like the examples! But I want to see how is the generated LaTeX code.)
There were already a couple of tools in this space for folks to contrast/compare:
inftyeditor: https://www.inftyproject.org/en/software.html
ffes: https://www.cs.rit.edu/~rlaz/ffes/
TeXview.app had an option to enter a single character using a graphics tablet or mouse which worked quite well (and allowed me to type up notes for a college professor).
I uploaded a picture of handwritten note. Why doesn't it return latex code? Below is the output(source code part) of your website:
二. 毕萨伐尔定律: B=∫dB = ∫(μ₀I dl × eᵣ)/(4πr²)
1. 载流长直导线. [图示：三角形，角度θ₁、θ₂，电流方向向里（叉号）] B = (μ₀I)/(4πr₀) (cosθ₁ - cosθ₂) = (μ₀I)/(4πr₀) [cosθ₁ + cos(π - θ₂)] 无限长直导线: B = μ₀I/(2πr) 半无限长直导线: B = μ₀I/(4πr₀)
推导: dB = (μ₀)/(4π) · (Idz sinθ)/r² B = ∫(μ₀I dz sinθ)/(4πr²) 由于各电流元产生的磁场方向相同 z = r₀ ctg(π - θ) = -r₀ ctgθ dz = r₀ dθ/sin²θ r = r₀/sin(π - θ) = r₀/sinθ B = ∫(μ₀I r₀ dθ sinθ)/(4π r₀²/sin²θ · sin²θ) = ∫(μ₀I sinθ dθ)/(4πr₀) = (μ₀I)/(4πr₀) ∫_{θ₁}^{θ₂} sinθ dθ = (μ₀I)/(4πr₀) (cosθ₁ - cosθ₂) = (μ₀I)/(4πr₀) [cosθ₁ + cos(π - θ₂)]
载流圆线圈在轴线上: 注 若有N匝则 需要乘以N [图示：圆线圈，轴线上点P，半径R，距离x，电流元Idl，磁场方向沿x轴] Bₓ = (μ₀p²I)/[2(p² + x²)^(3/2)] ① x=0, 即电流环中心的磁感应强度: B = μ₀I/(2R) ② x≫a, (p² + x²)^(3/2) ≈ x³, B = (μ₀Ip²)/(2x³) 引入磁矩, \(\vec{m} = I\vec{S} = IS\vec{e}_n\) 对任意形状的平面载流线圈都适 轴线上的磁感应强度, \(\vec{B} = \frac{\mu_0 I p^2 \vec{e}_n}{2x^3} = \frac{\mu_0}{2\pi} \frac{\vec{m}}{x^3}\)
推导: 由图和右手定则可以判断出磁场只有沿x的分量 dB = (μ₀I)/(4πr²) dl cosα = p/r = p/√(p² + x²) Bₓ = (μ₀I cosα)/(4πr²) ∮dl = (μ₀I p)/(4πr² r) · 2πp = (μ₀I p²)/(2r⁴) = (μ₀I p²)/[2(p² + x²)^(3/2)]
I'm always happy to see more innovation in this area. It'd be great if you could make your model, weights, and training corpus public (preferably under a permissive license) on GitHub. It'd also be great if you could run some benchmarks against the other similar tools in this area (I'm thinking particularly of Mathpix, Equatio, and Microsoft's math OCR in OneNote, Word, and Azure APIs. If you make your test corpus and code available I could set up the benchmarks for you.
Any reason for using a transformer architecture? You look at https://olmocr.allenai.org/ which does the best handwritten-to-latex in my opinion also does use VLM.
Also maybe xD not use LLMs to generate your HN description.
I won't log in to a site i don't know or trust
This is great! The LaTeX community will grow much more thanks to user friendly tools.
Do you have an api?
is the source open?
Thank you! The other popular tools I'm aware of in this space is MathPix [1] (paid) and Latex-OCR [2] (oss)
[1] https://mathpix.com/image-to-latex [2] https://github.com/lukas-blecher/LaTeX-OCR