Kelsey Kraushttps://kelseykraus.github.io/Kelsey KrausWowchemy (https://wowchemy.com)en-usFri, 31 Jul 2026 00:00:00 +0000https://kelseykraus.github.io/media/logo_hu13837894384518818825.pngKelsey Kraushttps://kelseykraus.github.io/<link>https://kelseykraus.github.io/teaching/current.html</link><pubDate>Fri, 31 Jul 2026 00:00:00 +0000</pubDate><guid>https://kelseykraus.github.io/teaching/current.html</guid><description><h2 id="fall-2026-courses">Fall 2026 Courses</h2> <table> <thead> <tr> <th>Course</th> <th></th> <th>Meet</th> <th></th> <th>Time</th> </tr> </thead> <tbody> <tr> <td>Ling 26: Quant. Reasoning in Linguistic Diversity</td> <td>   </td> <td>Mon &amp; Weds</td> <td>   </td> <td>9:00 - 10:15</td> </tr> <tr> <td>Ling 115: Corpus Linguistics</td> <td>   </td> <td>Tues &amp; Thurs</td> <td>   </td> <td>10:30 - 11:45</td> </tr> <tr> <td>Ling 165: Introduction to Natural Language Processing</td> <td>   </td> <td>Tues &amp; Thurs</td> <td>   </td> <td>13:30 - 14:45</td> </tr> </tbody> </table></description></item><item><title/><link>https://kelseykraus.github.io/research/evaluation.html</link><pubDate>Mon, 13 Oct 2025 00:00:00 +0000</pubDate><guid>https://kelseykraus.github.io/research/evaluation.html</guid><description><h2 id="human-in-the-loop-ai-evaluation">Human-In-The-Loop AI Evaluation</h2> <p>Recently, my research has focused on how to integrate human feedback into training and evaluating large language models, with a focus on improving performance and ensuring alignment with user preferences in real-world contexts. This work demonstrates the limitations of automated metrics in capturing nuance, especially in sensitive tasks like summarization or toxicity detection, and proposes human-centered methodologies that prioritize meaningful evaluation and data curation.<br><br>A few recent papers and defensive publications can be found here:</p></description></item><item><title/><link>https://kelseykraus.github.io/research/evaluation_a.html</link><pubDate>Mon, 13 Oct 2025 00:00:00 +0000</pubDate><guid>https://kelseykraus.github.io/research/evaluation_a.html</guid><description><ul> <li>2025: <a href="https://arxiv.org/abs/2503.04910">Maximizing Signal in Human-Model Preference Alignment.</a> <em>Joint work with Margaret Kroll</em></li> <li>2024: <a href="https://arxiv.org/abs/2410.18218">Optimizing the role of human evaluation in LLM-based spoken document summarization systems.</a> <em>Joint work with Margaret Kroll</em></li> <li>2024: <a href="https://www.tdcommons.org/cgi/viewcontent.cgi?article=8197&context=dpubs_series">Lightweight Retrieval Augmented Generation (RAG) Evaluation Pipeline.</a> <em>Joint work with Margaret Kroll</em></li> </ul></description></item><item><title/><link>https://kelseykraus.github.io/research/prosody.html</link><pubDate>Mon, 13 Oct 2025 00:00:00 +0000</pubDate><guid>https://kelseykraus.github.io/research/prosody.html</guid><description><h2 id="pragmatics--prosody">Pragmatics &amp; Prosody</h2> <p>I also work on exploring the connections between formal semantics, pragmatics, and prosody, with a focus on how intonation and discourse particles influence speech acts in empirically grounded ways. A central theme is understanding how these elements, especially in expressions of surprise, function to modify the speech act itself across different languages.<br><br>You can find some of this work here:</p></description></item><item><title/><link>https://kelseykraus.github.io/research/prosody_a.html</link><pubDate>Mon, 13 Oct 2025 00:00:00 +0000</pubDate><guid>https://kelseykraus.github.io/research/prosody_a.html</guid><description><ul> <li>2019: <a href="https://ojs.ub.uni-konstanz.de/sub/index.php/sub/article/view/596">Intonation and Expectation: English mirative contours and particles.</a></li> <li>2018: <a href="https://escholarship.org/uc/item/9sz4k1rm">Great Intonations.</a> <em>Dissertation</em></li> </ul></description></item><item><title/><link>https://kelseykraus.github.io/teaching/past.html</link><pubDate>Thu, 09 Oct 2025 00:00:00 +0000</pubDate><guid>https://kelseykraus.github.io/teaching/past.html</guid><description><h2 id="past-courses">Past courses</h2> <table> <thead> <tr> <th>Instructor of Record, San Jose State</th> <th></th> <th></th> </tr> </thead> <tbody> <tr> <td>Ling 101: Introduction to Linguistics</td> <td>       </td> <td>Spring 2026</td> </tr> <tr> <td>Ling 115: Corpus Linguistics</td> <td></td> <td>Spring 2026</td> </tr> <tr> <td>Ling 220: Computational Linguistics 1</td> <td></td> <td>Spring 2026</td> </tr> </tbody> </table> <table> <thead> <tr> <th>Instructor of Record, UC Santa Cruz</th> <th></th> <th></th> </tr> </thead> <tbody> <tr> <td>Ling 80 K: Invented Languages</td> <td>       </td> <td>Spring 2023</td> </tr> <tr> <td>NLP 270: Linguistic Models of Syntax &amp; Semantics</td> <td></td> <td>Winter 2023, co-taught with Margaret Kroll</td> </tr> <tr> <td>Ling 144: Computational Methods for Linguists</td> <td></td> <td>Winter 2022</td> </tr> </tbody> </table> <table> <thead> <tr> <th>Teaching Assistant, UC Santa Cruz</th> <th></th> <th></th> <th></th> <th></th> </tr> </thead> <tbody> <tr> <td>Ling 80K: Invented Languages</td> <td>   </td> <td>Spring 2020</td> <td>   </td> <td><em>Instructor: Pranav Anand</em></td> </tr> <tr> <td>Ling 80K: Invented Languages</td> <td>   </td> <td>Spring 2019</td> <td>   </td> <td><em>Instructor: Pranav Anand</em></td> </tr> <tr> <td>Ling 80C: Language, Society, &amp; Culture</td> <td>   </td> <td>Spring 2018</td> <td>   </td> <td><em>Instructor: Jim McCloskey</em></td> </tr> <tr> <td>Ling 240: Pedagogy of Linguistics</td> <td>   </td> <td>Winter 2016</td> <td>   </td> <td><em>Supervisor: Pranav Anand</em></td> </tr> <tr> <td>Ling 240: Pedagogy of Linguistics</td> <td>   </td> <td>Fall 2015</td> <td>   </td> <td><em>Supervisor: Pranav Anand</em></td> </tr> <tr> <td>Ling 113: Syntax II</td> <td>   </td> <td>Spring 2015</td> <td>   </td> <td><em>Instructor: Jim McCloskey</em></td> </tr> <tr> <td>Ling 108: Poetry &amp; Language</td> <td>   </td> <td>Winter 2015</td> <td>   </td> <td><em>Instructor: Sandy Chung</em></td> </tr> <tr> <td>Ling 50: Semantics I</td> <td>   </td> <td>Fall 2014</td> <td>   </td> <td><em>Instructor: Donka Farkas</em></td> </tr> <tr> <td>Ling 80C: Language, Society, &amp; Culture</td> <td>   </td> <td>Spring 2014</td> <td>   </td> <td><em>Instructor: Jim McCloskey</em></td> </tr> <tr> <td>Ling 112: Syntax I</td> <td>   </td> <td>Spring 2012</td> <td>   </td> <td><em>Instructor: Sandy Chung &amp; Matt Wagers</em></td> </tr> </tbody> </table></description></item><item><title/><link>https://kelseykraus.github.io/admin.yml</link><pubDate>Mon, 01 Jan 0001 00:00:00 +0000</pubDate><guid>https://kelseykraus.github.io/admin.yml</guid><description/></item></channel></rss>