下载PDF
实例探究 > The William and Flora Hewlett Foundation: Targeting Education Through Data Science

The William and Flora Hewlett Foundation: Targeting Education Through Data Science

技术
  • 分析与建模 - 数据挖掘
  • 分析与建模 - 机器学习
  • 分析与建模 - 预测分析
适用行业
  • 教育
适用功能
  • 商业运营
  • 质量保证
用例
  • 自动化疾病诊断
  • 质量预测分析
  • 远程协作
服务
  • 数据科学服务
  • 软件设计与工程服务
挑战
Education experts agree that essay writing is better than multiple choice tests for measuring essential skills like critical thinking, communication, and collaboration. However, because essays are more expensive and time consuming to grade, most standardized tests are still multiple-choice. In Kaggle’s Automated Student Assessment Prize (ASAP), the Hewlett Foundation challenged participants to build data science tools to help teachers and public education departments to grade essays consistently, quickly, and affordably—without sacrificing quality.
关于客户
The William and Flora Hewlett Foundation is a private foundation established by the Hewlett family. It is one of the largest philanthropic organizations in the United States, with a focus on solving social and environmental problems at home and around the world. The foundation supports a wide range of initiatives, including education, global development, and the environment. In the context of this case study, the foundation is particularly interested in improving the quality and efficiency of educational assessments. By leveraging data science and machine learning, the foundation aims to create tools that can assist teachers and educational institutions in grading essays more consistently and affordably, thereby enhancing the overall quality of education.
解决方案
Phase 1 of the competition included more than 22,000 hand-scored, long-form student essays that varied in length, topic, and grading protocol. Participants were challenged to develop models that could reproduce the scores given by expert human graders. Along with Kaggle’s community, eight commercial vendors of education software were invited to participate. The top five Kaggle teams outperformed all of the commercial vendors and even showed more consistency than the expert human graders. The winning team, which included a British particle physicist, an American weather analyst, and a German computer science student, ultimately sold the intellectual property behind their solution. Phase 2 tackled the even more difficult problem of short answers. The data included more than 27,000 hand-scored short answers around 50 words, covering topics from English to science. Results showed great promise: The top teams did not outperform human graders, but did outperform an automated benchmark by almost 20%. The winning teams presented their solutions to the sponsors and publicly released all code and writeups for use in future research.
运营影响
  • The top five Kaggle teams outperformed all of the commercial vendors and even showed more consistency than the expert human graders.
  • The winning team, which included a British particle physicist, an American weather analyst, and a German computer science student, ultimately sold the intellectual property behind their solution.
  • The top teams did not outperform human graders, but did outperform an automated benchmark by almost 20%.
数量效益
  • Phase 1 included more than 22,000 hand-scored, long-form student essays.
  • Phase 2 included more than 27,000 hand-scored short answers around 50 words.
  • The top teams outperformed an automated benchmark by almost 20%.

相关案例.

联系我们

欢迎与我们交流!

* Required
* Required
* Required
* Invalid email address
提交此表单,即表示您同意 IoT ONE 可以与您联系并分享洞察和营销信息。
不,谢谢,我不想收到来自 IoT ONE 的任何营销电子邮件。
提交

Thank you for your message!
We will contact you soon.