AICOM: Universal Medical AI Assistant

Despite the progress achieved at the global level, many health systems are not sufficiently prepared to respond to populations' growing demands for healthcare services. Inequitable access to healthcare continues to impede progress toward achieving universal health coverage (UHC). According to UN, 30% of the world’s population lacks access to essential health services and over 1 billion people in the world today are forced to live in extreme poverty due to high health expenses. It is expected to see up to one-third of the world's population remain underserved by 2030, especially in disadvantaged population groups as well as least developed countries (LDCs). According to UN, only 17% of mothers and children in the poorest fifth of households in low- and lower-middle-income countries received at least six of seven basic maternal and child health interventions, compared to 74% for the wealthiest fifth of households.

As the first step to answering (UN) Sustainable Development Goal (SDG) 3, we have launched the AICOM project to develop health AI technologies on affordable mobile phones to improve healthcare access for the underserved and hard-to-reach population. Not only will our technologies provide disease diagnosis service, but enable offline deployment of medical large language model in the near future.

We have completed phase one of AICOM and released AICOM-MP, which has achieved state-of-the-art results on monkeypox screening on affordable mobile phones. We chose to target the recent global monkeypox outbreak, a monkeypox is a highly contagious skin disease which causes rash-like lesions. Up to Sep 11th 2023, there have been 90,439 global cases in 115 locations, including 157 deaths. Clinical diagnoses for Monkeypox can be conducted through a biopsy or a polymerase chain reaction (PCR) laboratory test. However, these tests are expensive, and LDCs may not be able to afford mass-scale PCR testing. 

Access to healthcare, especially primary care, is difficult in many countries. This problem further exacerbates in the current COVID-19 situation. Three challenges need to be overcome for us to address the healthcare access problem in the Western Pacific Region. The first challenge is access itself; people get denied access to healthcare services for various reasons, including lack of mobility, particularly for disabled people and the elderly, unpleasant user experiences, especially for countries with overloaded public healthcare systems, etc. The second challenge is equity. The reality is that healthcare resources are unevenly distributed, and this distribution is often strongly correlated with wealth distribution. The third challenge is efficiency; as the overall healthcare cost is climbing, people have high hopes for new technologies to improve healthcare access and quality while minimizing costs. 

Technological advancements have always been a driving force for progress in healthcare, we believe technology is the solution to improve healthcare access, equity, and efficiency.  We have already demonstrated health AI on affordable mobile phones is an effective way to improve healthcare access in the least developed countries. Particularly, we have observed a continuously rising rate of smartphone usage in the least developed countries in recent years, and the costs of smartphones have been dropping rapidly. Hence, providing health AI capabilities on affordable mobile devices can be a viable solution to reach the unreached.

In the first phase of the AICOM project, AICOM-MP combines mobile computing and health AI technologies to enable effective monkeypox screening on low-end mobile phones, and has achieved state-of-the-art screening results. In addition, we have generalized a methodology to expand AICOM-MP to cover other diseases, such as measles, chickenpox, eczema, etc.

In the second phase of the project, AICOM combines large language model and medical expertise to enable efficient offline medical consultation on mobile devices. We are currently testing our prototype and have released a dev-version of the application.

More Information Regarding the Progress of Our Solution can be found below:

Technical Details: https://arxiv.org/abs/2211.14313

the United Nations ITU https://aiforgood.itu.int/ai-c...

Bulletin of the World Health Organization: https://apps.who.int/iris/hand...

World Economic Forum: https://www.weforum.org/agenda... 

Demo: https://youtube...

Note that We have open-sourced the dataset and source code of AICOM-MP to maximize coverage of the developed technologies.

AICOM aims to offer essential health technologies that’s safe, affordable, and effective, with a special emphasis on the poor, vulnerable and marginalized segments of the population, particularly people in the least developed countries (LDCs).

Among the list of LDCs provided by the United Nations, 33 countries are classified as least developed countries in Africa, they account for the largest proportion of the lDCs. Thus, to field-test our project’s feasibility in LDCs, we intend to target Africa as our primary client-based community for users to learn and experiment with AICOM. 

Following the development of AICOM-MP, we plan to extend our health AI software by developing additional AI-powered image processing functions to cover the most common infectious diseases with skin lesions in Africa.

AICOM prioritizes the development of medical-grade AI applications that are compatible with phones that are cheap, easy-to-use, and equipped with limited computing resources. According to online research, we summarized the top ten most used smartphones in Africa as the following: Tecno, Itel, Infinix, Samsung, Xiaomi, HUAWEI, OPPO, HMD Nokia, Apple, and REALME. Hence, we focus on running AICOM-MP APP on TECNO mobile devices which are usually installed with a MediaTek chip, to examine AICOM-MP's performance in such hardware environments, and validate its ability to operate under no or limited network connectivity. 

Dr. Shaoshan Liu's experience in fields of technology, entrepreneurship, and public policy enables him to take on great global challenges.  On technology, Dr. Liu has published 4 textbooks, 100+ research papers, and holds 150+ patents in artificial intelligence. On entrepreneurship, Dr. Liu has been the CEO of PerceptIn and has commercially deployed autonomous micro-mobility services worldwide. He is the Asia Chair of IEEE Entrepreneurship. On public policy, Dr. Liu has served on the World Economic Forum’s panel on Industry Response to Government Procurement Policy and is a member of the ACM U.S. Technology Policy Committee. He is an IEEE Senior Member, an IEEE Computer Society Distinguished Speaker, an ACM Distinguished Speaker, a member of MIT Technology Review’s Global Insights Panel, and a member of the Forbes Technology Council. Dr. Liu provides technical guidance and develops the roadmap for the AICOM project.

Ms. Ao Kong has 17 years of international management experience in global strategy, technology for peace and development, and multi-sector partnerships working for the United Nations, and in ESG investing and leadership role for the Tech industry. She recently became Senior Programme Advisor and Chief of Resource Mobilization and Strategic Communications at UN Technology Bank for Least Developed Countries. She serves on MIT Solve judge panel guiding tech-based social entrepreneurs to solve world challenges.  She is awarded as the “Pacific Delegate” by Carnegie Council for Ethics in International Relations. Ms. Kong develops visions for the AICOM project and provides essential insights into how AICOM can solve the global healthcare access problem.

Dr. An Na is a Doctor of Public Health student and Prajna Fellow at the Harvard T.H. Chan School of Public Health, she has worked in the field of humanitarian aid for more than a decade, and as part of the hospital management team for the International Committee of the Red Cross in Yemen and Afghanistan since 2019. She covered multiple positions while facing all the challenges in resources limited settings during COVID-19. Dr. Na brings in-depth medical expertise to the AICOM project and provides public health analysis to address real-world healthcare access problems through AICOM.

Prof. Xue Liu is a Chair Professor at McGill University. He is a VP of R&D, Chief Scientist, and Co-Director of the Samsung AI Center Montreal. He is a Fellow of the Canadian Academy of Engineering, an IEEE Fellow, and an ACM Distinguished Member.  He has been conducting innovative research and product development in both academia and industry ranging from early-stage startups to blue-chip companies. Prof. Liu provides technical guidance to the AICOM project.

Tianyi and Tianze Yang are master of computer science students at McGill University. They majored in Statistics and minored in CS during their undergraduate studies. They have had 3 years of research experience conducted in 7 labs supervised by well-known professors. These experiences prepared them to address convoluted problems in human society from a mathematical and computational perspective. They are the main developers of the AICOM project.

Although many health AI solutions have been proposed in the past decade, enabling health AI, especially LLM-powered health AI on affordable mobile phones is the true solution to reach the underserved and unreached. 

AICOM addresses the healthcare access problem by bringing healthcare services to the underserved and hard-to-reach patient's mobile devices and addresses the healthcare efficiency problem by enabling AI doctors to conduct rapid disease screenings. Along with the embedded energy-constrained quantization optimization (EQO) technique which adjusts the number of CPU threads used by the app according to the mobile device's battery level, charging state, and available memory, AICOM-MP undergoes a float-16 quantization process which makes it capable of conducting monkeypox screening without an over-reliance on computing environments. In addition, users with limited or no connectivity can still access our medical AI technologies on mobile. Moreover, we are in the process of integrating a medical LLM into our AICOM-MP app through efficient fine-tuning, retrieval augmentation, and bit-wise quantization methods. In short, our AICOM-MP app has demonstrated the fundamental possibility of deploying a medical grade machine learning model to low-end mobile devices with minimal loss in performance. 

Through combining mobile computing optimization techniques and deep learning techniques, we have achieved state-of-the-art monkeypox screening results. We have open-sourced the dataset and source code so that people around the globe can easily access the technology, either directly use AICOM-MP, or integrate AICOM-MP into their products and services.

AICOM, the Universal Medical AI Assistant, directly addresses UN Sustainable Goal 3 by improving access to healthcare services and promoting well-being for underserved and remote communities through the integration of advanced health AI technologies in cost-effective mobile devices. This initiative is crucial as it targets the significant global challenge of inequitable access to healthcare, which affects approximately 30% of the world’s population and results in over a billion people living in extreme poverty due to high health expenses.

AICOM is designed to improve healthcare accessibility for populations in least developed countries (LDCs), particularly in Africa, where a significant proportion of the world's underserved populations reside. By developing medical-grade AI applications compatible with affordable and commonly used smartphones in these regions, AICOM ensures that vital health technologies are within reach of those who need them the most. This includes providing AI-powered image processing functions to cover common infectious diseases with skin lesions prevalent in Africa.

The AICOM-MP application, which has already shown state-of-the-art results in monkeypox screening on low-end mobile phones, is an exemplary demonstration of the project's commitment to improving healthcare access. The technology combines mobile computing and health AI to enable effective screening for diseases like monkeypox, which has recently seen global outbreaks. This approach is cost-effective and practical, considering the rising smartphone usage and decreasing costs of smartphones in least developed countries.

By focusing on affordable and accessible healthcare solutions that leverage technology, AICOM aligns with the principles of UN Sustainable Goal 3. This initiative is an essential step towards achieving universal health coverage and ensuring that health and well-being are a reality for all, regardless of their geographical location or economic status.

AICOM integrates deep learning methods, large language model, mobile computing optimizations, medical know-hows, and public health tracking techniques into one product, we are not aware of any other products achieving the same degree of integration. This integration is practical in solving real-world healthcare challenges. 

Our advantage has been demonstrated through AICOM-MP, the first prototype of AICOM. First, we constructed a robust dataset with wide coverage, diversification, and generalization. Our dataset underwent a rigorous data selection process. We removed several artificially generated monkeypox images. We added 18 healthy face and 18 healthy hand high-quality images from the 11k hands dataset and Flickr-Faces-HQ dataset respectively, and collected 22 newly-found monkeypox images of high quality from seven published articles. Thus, the medical knowledge embedded in AICOM-MP AI is ensured to be precise, objective, and professional. Furthermore, compared to existing AI-based monkeypox detectors, AICOM-MP has achieved state-of-the-art performance.  Furthermore, to allow health AI professionals around the globe to integrate AICOM-MP into their services, AICOM-MP’s source code and dataset have been open-sourced. Moreover, aiming to enable the deployment of medical-grade machine-learning models to low-end mobile devices, we resort to a Float-16 quantization process which reduces the model size to 24 Mega Byets, which is less than 4% of the original model size, while ensuring a minimal loss in disease screening performance.

The medical LLM is developed using QLoRA fine-tuning method and canonical medical datasets such as "medalpaca/medical_meadow_mediqa" and "medalpaca/medical_meadow_mmmlu". 

To maintain the stability of our app when operating under limited computing resources, our app is implemented with an energy-constrained quantization optimization (EQO) technique which adjusts the number of CPU threads used by the app according to the mobile device's battery level, charging state, and available memory (heapsize) at the time of diagnosis. EQO adjusts higher and lower compute units based on mobile devices' hardware environment and ultimately helps our app to deploy the finite computing resources more effectively.

More technical details regarding AICOM-MP can be accessed here: https://arxiv.org/abs/2211.143...

In the development and deployment of AICOM, we prioritize ethical considerations and the responsible use of AI to mitigate potential risks associated with the technology.

1. Data Privacy and Security: We understand the sensitivity of health-related data and take measures to ensure that all data collected and processed by AICOM is secure and that the privacy of the users is protected. By moving all computing to mobile devices, AICOM does not require users to send any data to the cloud, and thus users do not have to worry about privacy.

2. Bias and Fairness: We are committed to addressing and mitigating biases in our AI models. Our team actively works to develop unbiased algorithms by using diverse and representative data sets. This approach ensures that the AI technology is fair and equitable, providing accurate and reliable results irrespective of the user's demographic characteristics.

3. Transparency: We believe in maintaining transparency in our AI models and algorithms. Detailed information about the technology, including its limitations and potential risks, is available to users and put on our website and GitHub.
   

Short-term impact goal - maximize download and monthly active users of AICOM to get people into the habit of utilizing their mobile phones for healthcare access. To enhance AICOM's capabilities in providing accurate responses to medical inquiries, we aim to integrate Large Language Models (LLMs) to improve its inference abilities in medical question-answering Particularly, we need MIT Solve to help us on public outreach and to achieve this short-term goal. 

Long-term impact goal - to enable public health benefits, particularly for people in LDCs, for instance, health performance and life expectancy for those who utilize the AICOM application vs. those who do not use the AICOM application. Moreover, to address privacy issues, we aim to construct a decentralized medical knowledge base to power AICOM's medical diagnosis capability.

• full-time staff : 3 people(Dr. Shaoshan Liu, Tianyi Yang, Tianze Yang)
• part-time staff : 3 people(Dr. Na An, Ms. Ao Kong, Prof. Xue Liu)
• contractors or other workers: 0

one year

Diversity: AICOM welcomes partners, scientists and development agencies from every social and cultural back-ground. 

Equity: Everyone in the team will be provided with the same opportunities, resources, and expectations to thrive. Policies and practices will be designed in a unbiased manner such that everyone is treated objectively without discrimination. 

Inclusion: AICOM is dedicated to creating an inclusive and aspiring working environment in which everyone is respected and valued. To ensure long-lasting progress, AICOM makes sure that everyone’s proposal, ideas, and
opinions are heard and treated in a transparent and just manner

AICOM has been incubated as an open-source project to achieve ubiquitous adoption of health AI technologies on mobile devices. In the initial phase, AICOM will rely on outside funding to sustain its growth. Meanwhile, we are developing proprietary, fee-based version of the application for users in more advanced economies to become self-sufficient and to enable organic growth.  

Technological advancements have always been a driving force for progress in healthcare, we believe technology is the solution to improve healthcare access, equity, and efficiency globally.  Particularly, we have observed a continuously rising rate of smartphone usage in LDCs in recent years, and the costs of smartphones have been dropping rapidly. Hence, providing health AI capabilities on affordable mobile devices have tremendous market potential, starting with empowering healthcare access for people in LDCs.

In the initial phase, AICOM will rely on outside funding to sustain the growth of AICOM. Meanwhile, we will develop proprietary, fee-based version of the application for users in more advanced economies to become self-sufficient and to enable organic growth.

Specifically, at the current stage, AICOM operates based on available funding and mainly focus on non-profit activities, the support mainly comes from McGill University. AICOM will work on gathering reputations among the healthcare marketplace and creating a credible image among the user communities through public speeches on globally recognized platforms, such as UN, and research publications. 

In the second stage, AICOM will develop a proprietary version of its AI doctor to serve customers with more specialized medical needs. It will incorporate a new subscription business model that offers high-end healthcare services targeted toward more specific diseases for people in developed countries. 

The current operating costs are zero since all the technologies we developed by ourselves and that all the team members work on a voluntary basis.

As for next yera, the projected operating costs for the next year would include the cost of the GPUs, which is approximately $11,500 to $15,000

It would be reasonable to request the maximum amount of $100,000 in funding.

1. GPU Resources:

   • Purchase of NVIDIA GeForce RTX 3090: Approximately $1,500 to $3,000.
   • Purchase of NVIDIA A100 GPU: Approximately $10,000 to $12,000.

2. Human Capital:

   • Salaries or stipends for the team members: The remaining amount would be allocated to cover human capital costs.

The maximum amount of $100,000 is requested to ensure that there are adequate resources to cover the costs of the necessary GPU resources and to fairly compensate the team members for their contributions to the project. This amount has been selected to provide a buffer to account for any potential unforeseen costs or fluctuations in the prices of the GPU resources.

The Cure Residency would provide invaluable support to our project by addressing key areas where we require assistance, facilitating the development of our medical large language models, and expanding our network within the AI and healthcare communities.

1. Seed Funding:

   • The funding will be used to purchase necessary GPU resources, such as NVIDIA A100 and NVIDIA 3090, to develop and train our medical large language models.

2. Mentorship:

   • Mentorship from experienced professionals in the AI and healthcare fields would be beneficial for refining our AI models and methodologies. Their insights can help us troubleshoot issues, optimize our processes, and enhance the overall efficacy of our project.

3. Lab Space:

   • Access to lab space will provide us with a conducive and cohesive environment for collaborative work and experimentation. This experience provides us with valuable insights into the state-of-the-art methods employed by the lab to tackle complex medical problems. We have the opportunity to explore innovative solutions proposed by the lab's researchers, and observe firsthand the development of groundbreaking innovations from their initial conception to full maturity. Additionally, we gain practical experience with professional-grade tools and access to extensive data resources, further enriching our understanding and skillset in the field.

4. Educational Programming:

   • Educational programming will keep us abreast of the latest developments in AI and medical technology, ensuring that our project incorporates the most advanced and effective solutions.

5. Networking Opportunities:

   • Networking will open up possibilities for collaboration and partnerships, allowing us to connect with other professionals and innovators in the field.

We are particularly excited about the funding, mentorship, and networking opportunities. The funding ensures that we have enough resources to advance and update our technologies. The guidance and insights from experienced mentors, coupled with the chance to connect and collaborate with other professionals and innovators, will be invaluable in enhancing our project and ensuring its success. Furthermore, the educational programming will equip us with new knowledge and skills that we can apply to improve our AI models and methodologies.