Inquire Biology
iPad app • SRI International & Vulcan Inc. • 2010 – 2011

Summary

Challenge: Build an iPad app that combines a biology textbook and a question-answering AI. What does a good e-textbook on iPad (which was new in 2010) need to have, and how should AI features integrate with it? How can we make a research AI system usable and useful for high school students?

Role: Designer, user researcher, iOS developer. I led a 10-person team of developers and biologists to create the app and improve the quality of AI-generated answers.

Outcome: We ran a controlled study with 74 high school students, which showed that Inquire increased engagement, satisfaction, and test scores. The project won an award at AAAI 2012.


Research

To understand the must-have features and existing best practices of e-books and e-readers, I conducted a competitive analysis of everything from mobile apps to hardware devices like the Kindle. There was no prior art in iPad textbooks — this was early 2010, when the iPad had been announced but not yet released.

Should users scroll content like a webpage or swipe between discrete pages? Textbooks have complex layouts with graphics and callouts, so changing the layout would affect the meaning. I presented pros and cons to our client; we decided on a scrolling layout as the more practical solution.


Concept Validation

I ran a focus group to validate several key features of the app:

  1. Navigation between the textbook, AI-generated answers to a user’s questions, and the user’s notes.
  2. Wikipedia-like glossary pages for key terms, which was a new concept I had develped during the research phase. These would be generated by the AI and linked from the text and answers.
  3. Suggested questions based on the user’s notes and highlights. Users could also enter free-form questions.

Each feature was presented in a storyboard lacking any specific UI, so users would focus on the concept. As the design progressed, I also used A-B testing, design reviews, and think-aloud usability studies to help refine the UX.


UX Design

I produced high-fidelity, interactive mockups that we could demo on a real iPad using Keynote. This gave us better feedback in user studies, because users didn’t have to imagine what using an iPad was like — remember, the iPad was brand new in 2010!

I also redesigned the structure and content of answers. I created HTML templates and worked with our biology experts to develop better heuristics for the AI, which (after dozens of iterations) resulted in a dramatic increase in answer quality and readability.


Visual Design & App Development

As we moved to development, I provided the production assets for the iPad app, including icons, buttons with multiple states, and sliced backgrounds. I also took the opportunity to learn iOS development, eventually taking over development of the Inquire app in its second year.

Screenshot of textbook with highlights and notes
Screenshot of an answer
Screenshot of a glossary page
Screenshot of asking a question

Controlled Study
Chart showing average grades
Chart showing grade distribution

In a study in January 2012, we tested Inquire against both electronic and paper versions of the textbook with groups of biology students from De Anza College. Each group of 24–25 students spent four hours studying a section of text, completing a homework assignment, and then taking a closed-book quiz.

Students using Inquire received significantly higher scores on the homework and quiz, a full letter grade on average. In addition, no Inquire student got a D or F on the quiz, while nearly a third of the other students did. This suggests Inquire may be especially helpful for lower performing students, which we hope to explore in a future study.


Project Website
Screenshots of project website
Screenshots of project website
Screenshots of project website

In 2012, I built the project website and led the creation of an award-winning project video. Our work was featured in New Scientist and AI Magazine.