Vital Sign AI’s free app detects vital signs remotely and non-invasively.

Smartphones (2020: 14B+) are an accessible technology during pandemics. Ideally, every human needs to get tested for COVID-19, and health being monitored during recovery.

Vital Sign Ai’s app uses the phones’ camera and audio data with machine learning (ML) to detect vital signs like heart rate and respiration.

They can be used for early symptoms analysis of COVID-19 and therapeutic methods to treat symptoms.

The users can share the data with consent to the healthcare provider for symptoms evaluation, remote 1:1 telehealth support or intake recommendations.

The app design is simple to be used easily by elderly, too. A simple engagement asks the users to share video and audio.

The documentation of the ML models, code and research and development of the open source project could potentially help with other diseases in the future. 

Our team uses machine learning models to detect for instance breathing patters from audio.

Symptoms of COVID-19 are shortness of breath among many others. Shortness of breath can be analyzed over time with machine learning using audio data.

The Vital Sign AI team is also developing an API that could be integrated into other applications for remote vital sign detection. 

Prognosis, monitoring and screening for the patients infected with COVID-19 is suggested to be based on vital signs such as respiration and blood oxygen saturation. Machine Learning (ML) methods have already shown promise and convincing results in the detection of vital signs.

Our application is helpful especially for people living remotely, elderly, and vulnerable and immuno-compromised people as well as people in under-resourced communities.

The project was started March 22, 2020, via the HelpWithCovid.com website, and currently has 170+ volunteering healthcare practitioners (HCP), data scientists, engineers and researchers from Stanford, Cornell Tech, and from various parts of the globe with institutional support. 

Please contact us (email: team@ our website’s name) if you want to help.

The app facilitates non-invasive and remote detection of vital signs such as heart rate variability, breathing patterns, and hemoglobin. This process relies on smart-phones and laptops to capture audio and video data, use state-of-the-art Machine Learning and Deep Learning algorithms to draw inferences, and subsequently make predictions. 

The app can also be used to practice suggested therapeutic exercises proposed for health at home, and ongoing mental and physical health monitoring. The vital sign detection shows progress and offers a motivating way to practice aerobic and mindfulness exercises as therapeutic methods.

A well-documented pipeline involving research and development provides long-term value to the medical, scientific and technical fields to detect other diseases, and provide therapeutic support at home.