I'm excited to share a new model I've been working on, alongside a brand new synthetic dataset. This project targets a very specific, practical problem in transportation.
š¦ Model: grhone/gemma-3-27b-atspm-gguf is a GGUF finetune of Gemma 3 27B Instructions Tuned, specialized for analyzing Automated Traffic Signal Performance Measures (ATSPM) charts. š¦ Performance: It achieved a 43.97% benchmark score on our custom ATSPM evaluation set, a slight lead over Gemini 2.5 Pro (43.94%) and a significant leap over the base Gemma 3 model (24.76%). š¦ Training Details: This was achieved by training on approximately 6% of the nodes for 2 epochs using the QLORA method. š¦ Dataset: grhone/atspm-dataset is a synthetic dataset containing 25,851 QA pairs and nearly 8.5 million tokens, created specifically for this project.