Qianting Gao

Master's

Computer Science

Data Engineering OP

- Python Data Processing Pipeline - Developed a pipeline for data cleaning, extraction, neural network prediction, and visualization using Python - Optimized functionality by determining the optimal crew using historical data from SQL Server and PI Server - Built a real-time updated data dashboard, resulting in more timely and reliable insights for decision-making - Logistics Dashboard - Created a dashboard tool for tracking daily activities, resource capacity, and downtime within the department - Integrated multiple data sources, including SQL Database and reports fetched via Power Automate (Power Fleet - Reduced manual workload by 80% through automated data consolidation and real-time data visualization - Machine Learning Prediction - Designed tool to analyze machine downtime and leverage relevant metrics to predict downtime - Employed existing data and LSTM modeling to achieve downtime predictions and achieved seamless data updates - Achieved over 90% prediction accuracy, integrated this tool with Python pipelines and the tool is widely used in weekly meetings - Personal Projects - Full Stack Web Development - Jan 2024 - Now - Developed the user interface of a dynamic website using JavaScript, React, and CSS, implementing responsive web design - Engineered the server-side logic and database interactions for a website using Python and Django framework, focusing on - RESTful API design and optimizing query performance for enhanced user experience - Delivered a website for an autonomous driving company, featuring sections such as product introduction, latest news, and about us - Parallel Implementation of Matrix Multiplication - Jan 2024 - May 2024 - Developed a parallel matrix multiplication using CUDA, MPI, and MPI I/O based on the Naive algorithm - Improved parallel processing with CUDA by chunking the input array into groups and optimizing the computation from left to right within each chunk - Showcased the potential of CUDA to perform matrix multiplication with long communication time between ranks, and achieved a high score of 100 in the course assessment - Web Server Based on Distributed Hash Table - May 2023 - Dec 2023 - Designed a fully functional Distributed Hash Table (DHT) using Kademlia protocol for efficient data storage and retrieval across multiple nodes - Utilized XOR-based distance metric for node identification and implemented mechanisms for bootstrapping, node - Improved data retrieval speeds and network resilience, demonstrating scalability across different network sizes