PyTorch Hackathon submission of an iOS app to convert images to LaTeX files.

May 2020 - Present

Background

As college students who often typeset assignments in LaTeX, we became interested in the possibility of creating an app that converts a handwritten document into a LaTeX file. We were really interested in learning more about computer vision and app development, so we decided to try implementing the idea and called it PicTeX.

We created PicTeX by using an RCNN model to preprocess images for regions of interest and then use a classifier to identify each symbol. We used PyTorch to train our classifier and S3 buckets to integrate the object detection model functionality into an iOS app.

Demo Video

https://www.youtube.com/watch?v=IQwyBaEmlQI

See The Project

View the Github Repo:

lenghuang/picTex

View the Devpost Submission:

PicTex

Skills Used

• SwiftUI

• Swift

• XCode

• AWS Amplify

• API Gateway

• S3

• Lambda

• Cloudfront

Group Members

This project would not have been possible without the help of Erica Chiang and Zach Nowak