{"id":4345,"date":"2025-10-10T10:29:16","date_gmt":"2025-10-10T14:29:16","guid":{"rendered":"https:\/\/oge.mit.edu\/msrp\/?post_type=profiles&p=4345"},"modified":"2025-12-09T11:28:41","modified_gmt":"2025-12-09T16:28:41","slug":"andre-braga","status":"publish","type":"profiles","link":"https:\/\/oge.mit.edu\/msrp\/profiles\/andre-braga\/","title":{"rendered":"Andr\u00e9 Braga"},"content":{"rendered":"
\n
\"\"<\/figure>\n<\/div>\n\n\n
\n

MIT Department: <\/strong>Electrical Engineering and Computer Science
Faculty Mentor<\/strong>: Prof. Jacob Andreas
Research Supervisor: <\/strong>Mehul Damani
Undergraduate Institution:<\/strong> University of California, Santa Barbara
Website<\/strong>:<\/p>\n<\/div><\/div>\n\n\n\n

<\/div>\n\n\n\n

<\/p>\n\n\n\n

Biography<\/strong><\/h4>\n\n\n\n

Andr\u00e9 Braga is a rising third-year Statistics & Data Science major at the University ofCalifornia, Santa Barbara, and a 2025 MIT MSRP intern in the Computer Science Department. Working with Professor Jacob Andreas, he uses reinforcement learning to make large language models more trustworthy, with an emphasis on uncertainty estimation. At UCSB he researches with Professors Xifeng Yan and Mingsong Yan, investigating attention-scaling techniques that enhance long-context reasoning and retrieval-augmented generation in transformer models, aiming to make large language systems faster and more interpretable. He also contributed to an AI-driven financial forecasting project with Professor Yan that explored feedback loops between search and prediction agents. Beyond academia, Andr\u00e9 co-founded Shofo, a startup where he designs fine-tuning workflows and user-facing machine-learning infrastructure for large-scale social-media analytics. He plans to pursue a Ph.D. in machine learning, developing novel architectures for trustworthy, interpretable continuous learning.<\/p>\n\n\n\n

Abstract<\/strong><\/h4>\n\n\n\n

Training ChatGPT to Double-Check Itself with a Separate ‘Judge’ Model<\/strong><\/p>\n\n\n\n

\n
\n
\n

Andre Braga1<\/sup>, Mehul Damani2<\/sup>, and Jacob Andreas2<\/sup><\/strong><\/p>\n\n\n\n

\n

1<\/sup>Department of Statistics, University of California, Santa Barbara<\/p>\n\n\n\n

2<\/sup>Department of Electrical Engineering and Computer Science, Massachusetts Institute of Technology<\/p>\n<\/div>\n<\/div>\n<\/div><\/div>\n<\/div><\/div>\n\n\n\n

<\/p>\n\n\n\n

Large language models (LLMs) often sound confident even when they are wrong, limiting their reliability in domains such as medicine or law, where it is vital to know when the model may not be certain of its answer. Existing methods for teaching these models to be more cautious typically judge only whether the final answer is correct or incorrect, but do little to explore the validity of how the model arrived at its answer. Our work proposes the use of a feedback-based training method called reinforcement learning that leverages an outcome reward model (ORM) to act as a separate \u2018judge\u2019 that scores both the answer and the reasoning process behind it. We then use this reward to train the LLM to adjust its behavior, learning not only to be correct but also to show caution if necessary, and even say \u201cI don\u2019t know\u201d when it’s unsure about its answer. By training language models with feedback from a reasoning-aware reward model, our approach addresses a gap in existing confidence-improvement methods that overlook the derivation of answers. This method produces models that are not only more accurate but also more cautious, able to express uncertainty appropriately, and ultimately better for real-world decision-making.\n<\/p>\n\n\n\n

<\/p>\n","protected":false},"featured_media":4346,"template":"","profile_category":[23],"class_list":["post-4345","profiles","type-profiles","status-publish","has-post-thumbnail","hentry","profile_category-2025-interns"],"acf":[],"_links":{"self":[{"href":"https:\/\/oge.mit.edu\/msrp\/wp-json\/wp\/v2\/profiles\/4345","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/oge.mit.edu\/msrp\/wp-json\/wp\/v2\/profiles"}],"about":[{"href":"https:\/\/oge.mit.edu\/msrp\/wp-json\/wp\/v2\/types\/profiles"}],"version-history":[{"count":3,"href":"https:\/\/oge.mit.edu\/msrp\/wp-json\/wp\/v2\/profiles\/4345\/revisions"}],"predecessor-version":[{"id":4786,"href":"https:\/\/oge.mit.edu\/msrp\/wp-json\/wp\/v2\/profiles\/4345\/revisions\/4786"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/oge.mit.edu\/msrp\/wp-json\/wp\/v2\/media\/4346"}],"wp:attachment":[{"href":"https:\/\/oge.mit.edu\/msrp\/wp-json\/wp\/v2\/media?parent=4345"}],"wp:term":[{"taxonomy":"profile_category","embeddable":true,"href":"https:\/\/oge.mit.edu\/msrp\/wp-json\/wp\/v2\/profile_category?post=4345"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}