Elektrine
Log in Register
Paige Chat Timeline Gallery Friends Email Drive DNS Private DNS Domains VPN Kairo Nerve
Remote

Jenn Wortman Vaughan

@jenn@sigmoid.social
mastodon 4.7.3
  • Open on sigmoid.social

Sr Principal Researcher, Microsoft Research, NYC. Responsible AI, machine learning transparency, intelligibility, fairness. WiML co-founder. NeurIPS 2021 Program Co-Chair. Brooklyn, NY.

567 Followers
118 Following
13 Posts
Joined December 09, 2022
Website:
http://jennwv.com
Open post
Jenn Wortman Vaughan @jenn@sigmoid.social
· 46mo ago

Heard I should write an #introduction? Ok.

Hi! I'm Jenn. I do research on #responsibleAI at Microsoft Research NYC. I'm in the FATE group and co-chair Microsoft's Aether working group on transparency.

My research background is in #machinelearning theory and algorithmic econ, but since my mid-career crisis I've focused on human-centered approaches to #transparency, #interpretability, & #fairness of AI.

I'm into #AI that augments, rather than replaces, human abilities.

http://www.jennwv.com

jennwv.com

Jenn Wortman Vaughan

50
2
20
0
Open post
Jenn Wortman Vaughan @jenn@sigmoid.social
· 46mo ago

Ok, people, I broke down and made a mastodon account! But I don't know who to follow or what to do with it.

Is anyone out there? Tell me how to get started!

19
7
14
0
Open post
Jenn Wortman Vaughan @jenn@sigmoid.social
· 46mo ago

I'm starting to plan a 12-week sabbatical for late summer/early fall during which I intend to disconnect from work as fully as possible.

Sharing because 1) committing publicly makes me more likely to go through with it, and 2) taking that much time off feels really scary to me because I don't see examples of people doing it. Maybe if I pull this off I can be that example for you.

9
1
0
0
Open post
Jenn Wortman Vaughan @jenn@sigmoid.social
· 34mo ago

The FATE group at Microsoft Research NYC is looking for interns and postdocs!

Relevant research themes include:

- Computational, statistical, & sociotechnical approaches to fairness assessment

- Human-centered AI transparency

- Institutional, organizational, & economic challenges of AI development, deployment, and use

- AI law and policy

- Responsible AI in practice

Interns (apply soon, we're reviewing applications now!): https://jobs.careers.microsoft.com/global/en/job/1661365/Research-Intern---FATE%2C-NYC-(Fairness%2C-Accountability%2C-Transparency%2C-and-Ethics-in-AI)

Postdocs: https://jobs.careers.microsoft.com/global/en/job/1667778/Post-Doc-Researcher–-FATE-–-Microsoft-Research

Careers at Microsoft
jobs.careers.microsoft.com

Careers at Microsoft

See all open jobs at Microsoft

3
0
10
0
Open post
Jenn Wortman Vaughan @jenn@sigmoid.social
· 40mo ago

Longer write-up on the #NeurIPS2021 consistency experiment now up on arxiv: https://arxiv.org/abs/2306.03262

Some takeaways:

- There was noise in 2014; there's noise now. Conference growth hasn't changed this much.

- Spotlights/orals are especially noisy. Being more selective would make decisions more arbitrary.

- The amount of noise in which papers get flagged for ethics review is also striking.

Has the Machine Learning Review Process Become More Arbitrary as the Field Has Grown? The NeurIPS 2021 Consistency Experiment
arXiv.org

Has the Machine Learning Review Process Become More Arbitrary as the Field Has Grown? The NeurIPS 2021 Consistency Experiment

We present the NeurIPS 2021 consistency experiment, a larger-scale variant of the 2014 NeurIPS experiment in which 10% of conference submissions were reviewed by two independent committees to quantify the randomness in the review process. We observe that the two committees disagree on their accept/reject recommendations for 23% of the papers and that, consistent with the results from 2014, approximately half of the list of accepted papers would change if the review process were randomly rerun. O

3
0
6
0
Open post
Jenn Wortman Vaughan @jenn@sigmoid.social
· 35mo ago

It's that time of year again! The FATE group at Microsoft Research NYC is accepting applications for 2024 interns. 🥳🎉

All internships will be in person again. We'll begin reviewing applications in early December. Cover letter required; see the posting for more details.

https://jobs.careers.microsoft.com/global/en/job/1661365/Research-Intern---FATE%2C-NYC-(Fairness%2C-Accountability%2C-Transparency%2C-and-Ethics-in-AI)

Careers at Microsoft
jobs.careers.microsoft.com

Careers at Microsoft

See all open jobs at Microsoft

2
0
6
0
Open post
Jenn Wortman Vaughan @jenn@sigmoid.social
· 40mo ago
Replying to
We argue for developing and designing approaches to transparency by considering stakeholder needs, novel types of LLM-infused applications, and new usage patterns around LLMs—all while building on lessons learned from human-centered research. We reflect on challenges that arise providing transparency for LLMs: complex model capabilities, massive opaque architectures, proprietary tech, complex applications, diverse stakeholders, rapidly evolving public perception, and pressure to move fast.
1
2
0
0
Open post
Jenn Wortman Vaughan @jenn@sigmoid.social
· 43mo ago

In bold decisions I may come to regret, I've registered for the NYC Marathon as part of my sabbatical plan for the fall. 😬😬😬 Save the date, NYC friends, because I'm expecting you to come out and cheer!

I will be running with Team Step for Refugees to support the UN Refugee Agency. I wrote more about why I'm running here: https://2023-nyc-marathon-unrefugees.funraise.org/fundraiser/jennifer-vaughan

Campaign Ended | Funraise
2023-nyc-marathon-unrefugees.funraise.org

Campaign Ended | Funraise

Campaign has ended.

1
0
0
0
Open post
Jenn Wortman Vaughan @jenn@sigmoid.social
· 40mo ago
Replying to
We synthesize lessons from HCI and RAI/FATE research—specifically, around taking a goal-oriented perspective, supporting appropriate levels of trust, the importance of mental models, the importance of how we communicate information, and the need to support control. Finally, we lay out 4 common approaches to transparency—model reporting, publishing evaluation results, providing explanations, and communicating uncertainty—and open questions around how these approaches might be applied to LLMs.
0
1
0
0
Open post
Jenn Wortman Vaughan @jenn@sigmoid.social
· 40mo ago
Replying to
We hope this sparks discussion! We’ll continue to iterate on this roadmap and would love to hear your constructive feedback.
0
0
0
0
Open post
Jenn Wortman Vaughan @jenn@sigmoid.social
· 23mo ago

The FATE group at Microsoft Research NYC is now accepting applications for 2025 interns. 🥳🎉

For full consideration, apply by December 18 and include a cover letter.

https://jobs.careers.microsoft.com/global/en/job/1786105/Research-Intern---FATE-NYC-(Fairness%2C-Accountability%2C-Transparency%2C-and-Ethics-in-AI)

Interested in AI evaluation? Apply for the STAC internship too!

https://jobs.careers.microsoft.com/global/en/job/1786108/Research-Intern---STAC-(Sociotechnical-Alignment-Center)

Careers at Microsoft
jobs.careers.microsoft.com

Careers at Microsoft

See all open jobs at Microsoft

0
0
0
0
Open post
Jenn Wortman Vaughan @jenn@sigmoid.social
· 39mo ago

Has anyone successfully run experiments on MTurk in the past 1 or 2 years? I find it impossible to collect usable data even with qualifications, captchas, extensive attention/location checks, etc.

What works these days???

(Would switch to Prolific if I could, but it's not an option.)

0
0
1
0
Back
313k7r1n3
Elektrine

Tor hidden service

elekhj7afj4qnrr4yd3bkzslsyo5jgfxw3orgjkhlcxifueodybyiiad.onion

I2P eepsite

j6b6cyk6gjmepjih7jjadxgxvvf3lzzujljuu2v4biemzpg3naya.b32.i2p

Platform

  • Email
  • Chat
  • Timeline
  • VPN
  • DNS

Company

  • About
  • Contact
  • FAQ
  • Lite (no JS)

Legal

  • Terms of Service
  • Privacy Policy
  • Transparency Report
  • Report Abuse
  • Warrant Canary
  • VPN Policy

Support

  • support@elektrine.com
  • Report Security Issue
Mail client setup IMAP mail.elektrine.com:993 POP3 mail.elektrine.com:995 SMTP mail.elektrine.com:465
© 2026 Elektrine. All rights reserved. Server: 23:24:14 UTC