Ritesh Bhalerao

S-KANformer: Enhancing Transformers for Symbolic Calculations in High Energy Physics

Optimizing Biomass Forecasting & Supply Chain : An Integrated Modelling Approach

SineKAN: A Flexible Machine Learning Model for Modelling L² Functions and Beyond (Co-author)

Optimizing Biomass Forecasting & Supply Chain : An Integrated Modelling Approach (Presenter)

Research Intern

• Exploring and advancing the potential of generative AI in identiying and addressing cybersecurity vulnerabilities.

Google Summer of Code Participant

• Developed Transformer models for symbolic calculations of particle interactions in High Energy Physics.
• Reduced the time by orders of magnitude compared to current calculation systems.
• Experience working with High Performance Computing Clusters like Perlmutter.
• Project link

Summer Research Fellow

• Developed a domain specialist chatbot by Retrieval Augmented Fine-Tuning of Llama 2 - Meta’s open-source LLM.
• Created an end-to-end domain-agnostic pipeline, including a custom Q&A data generation workflow.
• Repository link

Jr Technical Officer

• Development of council’s mobile application & website.
• Conducted technical workshops for 100+ students.

Vivekanand Education Society's Institute of Technology, Mumbai

B.A Talreja College, Badlapur

Percentage : 94.67

Shell.ai global Hackathon (Agricultural Waste Challenge 2023)

Our solution for Biomass supply chain optimization for state of Gujarat using ML and MILP was ranked 12th on global leaderboard

E-Yantra Innovation Challenge

EYIC is a national level competition . My team built an app called "Enabled" which is community platform for persons with disabilities. Pitch link

IIIT Sri City National Healthcare Hackathon - 2023

My team's solution - "Rhythm" which is a web and app based integrated platform in the domain of preventive cardio vascular self-care won 2nd prize at this hackathon.

S-KANformer: Enhancing Transformers for Symbolic Calculations in High Energy Physics

Developed and applied S-KANformer (Transformers infused with Kolmogorov-Arnold Networks Using Sinusoidal Activation Functions) for high-energy physics symbolic calculations, achieving state-of-the-art performance.

LlamaOS: Domain Specific Chatbot for Student Queries

This project develops an open-source chatbot by fine-tuning LLaMA 2 with RAFT, RAG, and a fine-tuned retriever using LLM-generated QnA data.

Detect PIID information in written essays

Detecting personally identifiable information (PII) in student writing using Longformer & Deberta. Bronze medal in this featured Kaggle competition.

Small Language Models for ecommerce

Fine-tuned Small Language Models (SLMs) to test their efficacy against LLMs on domain-specific tasks.

Symbolic Regression using Transformers

Transformer Models for Symbolic Regression trained on a subset of Feynman Dataset. You can find it here.

Biomass Supply Chain Optimization

Biomass yield forecasting using AutoML and large-scale optimization using Mixed Integer Linear Programming combined with density-based clustering. Solution for the Shell.ai Hackathon 2023.

LLM - Detect AI Generated Text

Identifying which essay was written by a large language model.

Enabled - Community platform app for PWDs

Feature packed and completely accessible application for PwDs.

NLP Specialization

Neural networks and Deep learning

Improving deep neural networks

Structuring Machine learning projects

Convolutional Neural Networks

Fundamentals of Deep learning

Applications of AI for anomaly detection

Applications of AI for predictive maintenance