Our 2 year goal, by the end of AY 24-25, is to produce GAI-enabled course structure across the introductory STEM curriculum.
The tools should be agnostic to the textbook(s) used in the course, and should be implementable with a minimal time investment in courses nationwide.
Initial backend is likely to be ChatGPT, currently at version 4, but we should strive to build an architecture that can evolve and adapt to new and better and different tools. We need to have an overall architecture philosophy evolve with our development spirals.
...
Item | experiments | courses | lead | GPT aspect needed | Validation criteria |
---|---|---|---|---|---|
A: Incorporation of GAI into lecture-format STEM learning:
|
| shared-edit document fed into GAI, results available to instructor. Multi-shot learning using restricted content and open PPT and math content upload as tokens | |||
B: Develop and Exploit short-cycle adaptive problem sets with real-time feedback
|
| Ability to identify main topics, and embed in GAI interaction. Arithmetic needs to work. | |||
C: Assist with analysis and gain insights from lab data. |
| notebook and GAI integration ability to access data files from instructional lab data collection. Does this mean a browser interface with access to local files? | |||
D: interactive student self-assessments. |
| ||||
F: GAI-assisted student assessments and grading | ability to capture GAI sessions, with unique student identifiers | ||||
G: Temperature-dependence of learning effectiveness |
| ||||
H: Ascertain subject-level mastery needed to exploit natural-langauge-driven code development. Try out a non-analytic problem and assess the results. |
| 15 a,b,c | numerical solution code | ||
I: incorporate into HW and assessments the ability to perform calculations, as pioneered by Khan Academy | same as B | arithmetic capability | |||
J: incorporate course-specific training inputs and give that high weighting | custom training inputs | ||||
K: Automation grading and assessments of student competence. | sequential prompts run open loop, no adjustment | ||||
L: dynamic tutoring | same as D | sequential prompts with iterative adjustment | |||
M: GAI assisted generation and refinement of course instructional and assessment materials- HW, exams, quizzes, etc. |
| ||||
N: Course management- facilitating course selection |
| Need to restrict dissemination of uploaded CUE score materials. | |||
O: Course management- |
| need to mesh student user account on GAI system with their HUID and course record. Instructor-level overview of | |||
P. Validation and verification tools and methods
|
|
|
Deliverable | impact (1-3 with 5 being high) 1: single course 2: 3-5 courses 3: >5 courses | effort scope (1-3 with 3 being low) 1: > 1 calendar month 2: ~ 1 calendar month 3: < 1 month | merit |
---|---|---|---|
classroom synthesis: Google form input to running canned prompts and displaying on screen, 1-button workflow | 3 | 1 | 3 |
implement nano-GPT in jupyter notebook | 2 | 3 | 6 |
implement ability to execute queries on course-specific uploaded materials | 3 | 1 | 3 |
facilitate upload of student sessions as parsable text into grading system | 3 | 2 | 6 |
implement course management tools- grade sheet analysis and interrogation | 3 | 2 | 6 |
incorporate chat functionality into course Slack channel | 3 | 3 | 9 |
new-course development toolkit | 3 | 2 | 6 |
preparation assessment facilitation based on instructor expectations | 3 | 2 | 6 |
instructional lab data browsing, tailored to individual courses | 1 | 1 | 1 |
generation of lecture notes from recorded transcripts and video capture of blackbaord? | 3 | 1 | 3 |
Dynamic HW system, multishot training to guide student interaction | 3 | 1 | 3 |
Assess optimal temperature setting to maximize learning effectiveness (this is an experiment) | 3 | 1 | 3 |
Assess performance of image capture HW assessment. "work this problem then upload image of your work" | 3 | 2 | 6 |
respondent | notes | |
---|---|---|
Carlos Argueles | carguelles@fas.harvard.edu | Hola Chris: Thanks for sending this email. I am very excited about this new technology. In fact, with Louis Deslauriers, we used some of it in my Physics 15B last semester. Carlos |
David Malin | using it now in CS50 with custom interface | |
...