Our 2 year goal, by the end of AY 24-25, is to produce GAI-enabled course structure across the introductory STEM curriculum. The tools should be agnostic to the textbook(s) used in the course, and should be implementable with a minimal time investment in courses nationwide.
This effort will take place in stages, as follows:
Summer 2023 - establish structure for the process, secure resources, build team, delineate clear goals for the Fall 2023 term, define a subset of experiments for Fall 2023
Fall 2023 - conduct initial set of GAIPedagogy experiments across the curriculum and
January 2024- Three day Workshop on STEM GAI pedagogy.
Spring 2023
Summer 2024
Fall 2024
...
| Item | experiments | courses | lead | GPT aspect needed | Validation criteria |
|---|---|---|---|---|---|
| Lecture components: active learning methodology that leverages GAI |
| ||||
| Develop and Exploit short-cycle adaptive problem sets with real-time feedback | |||||
| Assist with analysis and gain insights from lab data. | |||||
| interactive student self-assessments. | |||||
| In-class group consultation with ChatGPT | |||||
| capturing and submitting work for evaluation by course staff | |||||
| automated evaluation of understanding of material, by evaluating answers to questions we provide. | |||||
| try out a non-analytic problem and assess the results. |
| 15 a,b,c | numerical solution | ||
| include ability to perform calculations, as pioneered by Khan Academy | |||||
| incorporate course-specific training inputs and give that high weighting | custom training inputs | ||||
| Automation of grading and assessments of student competence. | sequential prompts run open loop, no adjustment | ||||
| dynamic tutoring | sequential prompts with iterative adjustment | ||||
| Generation and refinement of course instructional and assessment materials- HW, exams, etc. |
|
Course-based viewpoint
- Assess our assessments: run midterm and final exams of science courses through GPT-4 and grade the results. Compare to overall student performance.
- Enhance our assessments. Solicit constructive feedback on the exam questions we submit.
- Assess our homework: run homework assignments through GPT-4 and grade the results. Compare to overall student performance.
- Enhance our assignments. Solicit constructive feedback on the homework we submit.
- Ask (require?) students to use GPT-4 on selected assignments to get feedback and examples of how it can be used.
- Course-specific chat-bots- what training data?
- For large lecture classes- merge active learning with GPT
- For sections- aggregation of questions,
- For labs- try out data analysis methods and inference
- Customized training assembly of material - what do we need to start to capture?
- Khan academy like adaptive tutorials
...
- Learning how to craft a prompt that gets what you want
- GAI as a consultant
- iterative refinements
- validation tools
- critical thinking skillsGAI for self-assessment
- iterative refinements in GAI interactions
- Learning how to validate and verify results
- Honing critical thinking skills in the GAI context.
Specific examples :
Modulated Friction example
...