Our latest model advances bring stronger capabilities for building and migrating software in low-resource programming languages such as COBOL, Fortran, and Visual Basic. These languages have less code and documentation available for models to learn from than languages like Python and JavaScript, yet support critical infrastructure and essential services around the world. COBOL supports more than 40% of online banking systems, 80% of in-person credit card transactions and 95% of ATM transactions, while Fortran is used in weather forecasting and nuclear reactor safety analysis. Improving AI’s ability to work in these languages could help teams maintain and modernize the software that essential services depend on.
This work is guided by feedback from developers and enterprise customers who have told us that coding models often struggle with these languages. Maintaining and modernizing this software can be difficult: documentation may be incomplete, original developers may have left the company, and important business rules may only exist in code. Whether teams are fixing bugs or migrating to another language, they need to preserve the behavior their systems depend on. To measure progress, we developed two evaluations: Multi Lang Bench and COBOL migration evaluation.
On Multi Lang Bench, GPT‑6 Astra achieves an average test pass rate of 87.4% across 20 programming languages, up from 26.8% for GPT‑5.6 Sol, with improvements in every language tested. GPT‑6 Luna also outperforms GPT‑5.6 Sol, reaching 40.3% at approximately 78% lower estimated API cost. On our COBOL migration evaluation, GPT‑6.1 Sol achieves 86.6% accuracy at low reasoning effort, compared with just 5.4% for GPT‑5.6 Sol, while costing 39% less. At higher reasoning effort, accuracy reaches 97.9%, nearly saturating the evaluation.
FAQ Q: Why are low-resource programming languages like COBOL and Fortran still critical today?
FAQ A: These languages support essential infrastructure: COBOL powers over 40% of online banking systems, 80% of in-person credit card transactions, and 95% of ATM transactions, while Fortran is used in weather forecasting and nuclear reactor safety analysis.
出典: OpenAI Blog · 要約：HeadlinesBriefing