{"id":5140,"date":"2026-05-13T15:07:56","date_gmt":"2026-05-13T19:07:56","guid":{"rendered":"https:\/\/oge.mit.edu\/msrp\/?post_type=profiles&p=5140"},"modified":"2026-10-09T13:41:55","modified_gmt":"2026-10-09T17:41:55","slug":"khai-pham","status":"publish","type":"profiles","link":"https:\/\/oge.mit.edu\/msrp\/profiles\/khai-pham\/","title":{"rendered":"Khai Pham"},"content":{"rendered":"\n
\n
\n
\n
\"Pham,<\/figure>\n\n\n\n

MIT Department: <\/strong>
Institute for Data Systems and Society

Faculty Mentor<\/strong>:
Jacob Andreas

Research Supervisor: <\/strong>
Laura Ruis

Undergraduate Institution:<\/strong>
Rice University
<\/strong><\/p>\n\n\n\n

<\/p>\n<\/div>\n<\/div>\n<\/div>\n\n\n\n

Biography<\/strong><\/h4>\n\n\n\n

Khai Pham is a rising sophomore at Rice University\u2019s George R. Brown School of Engineering and Computing, where he is pursuing a Bachelor of Science in Computer Science. Originally from Sugar Land, Texas, Khai developed an early interest in mathematics and technology, which led him to pursue research in machine learning. This summer, Khai is conducting research at MIT\u2019s Computer Science and Artificial Intelligence Laboratory (CSAIL) through MIT’s Summer Research Program. Under the mentorship of Professor Jacob Andreas in the Language and Intelligence Group, Khai\u2019s work investigates out-of-context reasoning in large language models, specifically whether LLMs can infer and apply latent structure such as hidden relationships encoded in graph-based data. This line of research carries significant implications for AI safety and our understanding of what language models silently learn.<\/p>\n\n\n\n


Can LLMs Read Between the Lines?
<\/strong>Khai Pham1<\/sup>, Joshua West2<\/sup>, Laura Ruis3<\/sup>, Jacob Andreas3<\/sup>
1<\/sup>Department of Computer Science, Rice University
2<\/sup>Department of Electrical and Computer Engineering, North Carolina Agricultural and Technical State University
3<\/sup>Department of Electrical Engineering and Computer Science, Massachusetts Institute of Technology
<\/p>\n\n\n\n

Trained on internet data, text-based AI models can generate coherent responses. These AI models, called Large Language Models (LLMs), now drive innovation across nearly every industry. However, that training data may contain traces of concealed information that the model may reconstruct on its own. Prior research has tested whether models can recover hidden information from simple clues. However, real-world knowledge often involves complex webs of relationships rather than isolated facts. This research investigated whether an LLM can infer a network of connections (a graph) that was never explicitly described in training. We fine-tuned Qwen3-4B on synthetic directed acyclic graph (DAG) datasets before asking it relational questions about pairs of nodes not explicitly described in training. Even when trained on sparse graph data, an LLM can often identify whether two nodes are unrelated or share an ancestral relationship in DAGs. However, the model\u2019s reliability varies with the complexity of the graph structure it was trained on. These findings suggest that LLMs may be capable of piecing together complex relational knowledge that was never explicitly present in their training data. This raises concerns for companies, policymakers, and AI researchers working to understand what a model may silently learn.<\/p>\n","protected":false},"featured_media":5624,"template":"","profile_category":[25],"class_list":["post-5140","profiles","type-profiles","status-publish","has-post-thumbnail","hentry","profile_category-2026-interns"],"acf":[],"_links":{"self":[{"href":"https:\/\/oge.mit.edu\/msrp\/wp-json\/wp\/v2\/profiles\/5140","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/oge.mit.edu\/msrp\/wp-json\/wp\/v2\/profiles"}],"about":[{"href":"https:\/\/oge.mit.edu\/msrp\/wp-json\/wp\/v2\/types\/profiles"}],"version-history":[{"count":5,"href":"https:\/\/oge.mit.edu\/msrp\/wp-json\/wp\/v2\/profiles\/5140\/revisions"}],"predecessor-version":[{"id":6063,"href":"https:\/\/oge.mit.edu\/msrp\/wp-json\/wp\/v2\/profiles\/5140\/revisions\/6063"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/oge.mit.edu\/msrp\/wp-json\/wp\/v2\/media\/5624"}],"wp:attachment":[{"href":"https:\/\/oge.mit.edu\/msrp\/wp-json\/wp\/v2\/media?parent=5140"}],"wp:term":[{"taxonomy":"profile_category","embeddable":true,"href":"https:\/\/oge.mit.edu\/msrp\/wp-json\/wp\/v2\/profile_category?post=5140"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}