Our 2 year goal, by the end of AY 24-25, is to produce GAI-enabled course structure across the introductory STEM curriculum.
The tools should be agnostic to the textbook(s) used in the course, and should be implementable with a minimal time investment in courses nationwide.
Initial backend is likely to be ChatGPT, currently at version 4, but we should strive to build an architecture that can evolve and adapt to new and better and different tools. We need to have an overall architecture philosophy evolve with our development spirals.
...
Item | experiments | courses | lead | GPT aspect needed | Validation criteria |
---|---|---|---|---|---|
A: Incorporation of GAI into lecture-format STEM learning:
|
| shared-edit document fed into GAI, results available to instructor. Multi-shot learning using restricted content and open PPT and math content upload as tokens | |||
B: Develop and Exploit short-cycle adaptive problem sets with real-time feedback
|
| Ability to identify main topics, and embed in GAI interaction. Arithmetic needs to work. | |||
C: Assist with analysis and gain insights from lab data. |
| notebook and GAI integration ability to access data files from instructional lab data collection. Does this mean a browser interface with access to local files? | |||
D: interactive student self-assessments. |
| ||||
F: GAI-assisted student assessments and grading | ability to capture GAI sessions, with unique student identifiers | ||||
G: Temperature-dependence of learning effectiveness |
| ||||
H: Ascertain subject-level mastery needed to exploit natural-langauge-driven code development. Try out a non-analytic problem and assess the results. |
| 15 a,b,c | numerical solution code | ||
I: incorporate into HW and assessments the ability to perform calculations, as pioneered by Khan Academy | same as B | arithmetic capability | |||
J: incorporate course-specific training inputs and give that high weighting | custom training inputs | ||||
K: Automation grading and assessments of student competence. | sequential prompts run open loop, no adjustment | ||||
L: dynamic tutoring | same as D | sequential prompts with iterative adjustment | |||
M: GAI assisted generation and refinement of course instructional and assessment materials- HW, exams, quizzes, etc. |
| ||||
N: Course management- facilitating course selection |
| Need to restrict dissemination of uploaded CUE score materials. | |||
O: Course management- |
| need to mesh student user account on GAI system with their HUID and course record. Instructor-level overview of | |||
P. Validation and verification tools and methods
|
|
|
respondent | notes | |
---|---|---|
Carlos Argueles | carguelles@fas.harvard.edu | Hola Chris: Thanks for sending this email. I am very excited about this new technology. In fact, with Louis Deslauriers, we used some of it in my Physics 15B last semester. Carlos |
David Malin | using it now in CS50 with custom interface | |
...