Jisc Archives - TeacherMatic https://teachermatic.com/case_study_categories/jisc/ The Ultimate AI Assistant For Today's Educators Tue, 25 Feb 2025 08:39:03 +0000 en-US hourly 1 https://wordpress.org/?v=6.8.3 https://i0.wp.com/teachermatic.com/wp-content/uploads/2024/10/cropped-icon_circle_master.png?fit=32%2C32&ssl=1 Jisc Archives - TeacherMatic https://teachermatic.com/case_study_categories/jisc/ 32 32 215337049 TeacherMatic Higher Education Pilot Report https://teachermatic.com/case_study/jisc-higher-education-pilot-report/ Mon, 24 Feb 2025 16:12:59 +0000 https://teachermatic.com/?post_type=case_study&p=46040 TeacherMatic Higher Education Pilot Report The TeacherMatic Higher Education Pilot Report details a collaboration with Jisc’s artificial intelligence team. It

The post TeacherMatic Higher Education Pilot Report appeared first on TeacherMatic.

]]>

TeacherMatic Higher Education Pilot Report

The TeacherMatic Higher Education Pilot Report details a collaboration with Jisc’s artificial intelligence team. It demonstrates how the TeacherMatic platform streamlined content creation tasks and eased teachers’ workloads during a trial with higher education organisations. The results highlight TeacherMatic’s ease of use and time-saving benefits.

People sitting at a table in a library, working on laptops.

Contents

This report provides a comprehensive review of TeacherMatic, detailing its initial pilot implementation, evaluation results, participant experiences, future development plans, and a summary of key findings

An overview of TeacherMatic’s functionalities
Implementation of the pilot programme
Participant feedback and experiences

Evaluation of the pilot results
Insights from both phases of feedback
TeacherMatic’s roadmap and next steps
Summary of key outcomes
Download the full report

Introduction

Since its launch in 2023, TeacherMatic has been designed to help educators efficiently create high-quality learning materials using generative AI.

The platform was evaluated in a 2024 pilot with seven Higher Education (HE) institutions, ensuring ongoing improvements while aligning with ethical AI adoption. In collaboration with Jisc, the pilot assessed the quality of AI-generated content and its effectiveness in supporting educators while upholding ethical standards. Jisc’s pilot programmes provide institutions with first-hand experience of emerging technologies and generate insights for the wider education community.

The report presents key findings from the pilot, demonstrating how TeacherMatic supports educators by improving productivity and maintaining high-quality content creation.

A group of students listens as a teacher presents in a lab. One student raises their hand. A robotic arm and open laptop are on the table in the background.
Four people are sitting at a table with laptops, engaged in a discussion. A woman in the center is speaking, while others listen attentively. Bookshelves are in the background.

Pilot Parameters

The pilot aimed to trial TeacherMatic in higher education across various subject areas and academic levels, evaluating both the quality and relevance of AI-generated content. The goal was to assess how well the platform facilitated ethical and effective AI adoption in higher education.

A training session introduced participants to the platform and its functionalities. The pilot was then structured into two phases: Phase One ran from January to February 2024, followed by Phase Two from March to July 2024. Each participating institution received 50 licenses for 12 months, allowing approximately 350 educators to engage actively with and evaluate the platform.

The following HE institutions participated in the pilot:

✔ University College Birmingham

✔ Stranmillis University College

✔ University of Chester

✔ University of East Anglia

✔ University of Strathclyde

✔ University of Sunderland

✔ University of Westminster

Logos of seven universities: University College Birmingham, Stranmillis University College, University of Chester, University of East Anglia, University of Strathclyde, University of Sunderland, University of Westminster.

Key Participant Feedback and Findings

  • TeacherMatic significantly reduced time spent on resource creation and idea generation.
  • The user-friendly interface enabled educators to create diverse materials, such as presentation outlines, lesson plans and discussion topics, without prompt engineering expertise.
  • The platform positively impacted teaching methods, enhancing creativity and serving as a valuable starting point for tasks like lesson planning.
  • TeacherMatic is especially useful for remote educators, resulting in effectively generated and refined content when in-person collaboration is limited.
  • Content quality improved when participants uploaded materials they had created into the generator.
  • The feedback generator saved time and improved the quality of learner feedback.

Highlighted Areas for Development

✔ Enhance the academic level of generated content to better align with HE standards.
✔ Optimise the Bloom’s Taxonomy feature and complexity slider to meet HE requirements.
✔ Improve the PowerPoint generator by enhancing image quality, deepening content and expanding the ten-slide limit.

A woman in a white shirt works on a laptop at an office desk with papers nearby.

The Report in Numbers

69% of participants said TeacherMatic enhanced learning experiences by accelerating feedback, generating assessment and discussion topics and suggesting mentoring methods for students.

63% of participants would recommend TeacherMatic for HE.

86% of respondents said the pilot had enhanced their understanding of generative AI and its capabilities.

51% of participants said TeacherMatic saved time when creating teaching resources. On average, users said they saved two hours per week by using TeacherMatic.

68% of participants reported that TeacherMatic helped them get started when creating resources.

The Next Steps

With a focus on continuous improvement and enhancing the user experience, TeacherMatic has acknowledged participants’ feedback, with the following enhancements already underway to better align with HE requirements.

✔ The complexity slider is replaced with a more advanced system for greater control over output levels.
✔ A new system will replace the Bloom’s Taxonomy feature, incorporating alternative pedagogical models such as Rosenshine’s instructional principles and SOLO, as well as sector-specific options for HE and FE.
✔ A text-only presentation generator has been introduced, featuring a preview function, slide regeneration and AI-generated images to improve subject coverage.

These developments reflect TeacherMatic’s ongoing commitment to supporting educators with effective, high-quality AI-driven tools.

Group of young asian creative business brainstorm meeting presentation, discussing roadmap to

Summary

The TeacherMatic Higher Education Pilot Report highlighted the platform’s strengths in streamlining resource creation and enhancing educators’ creativity. Particularly valuable for remote educators, it provided an intuitive way to generate diverse teaching materials, with positive feedback on its ease of use and impact across various subjects and levels.

Download the full report

The post TeacherMatic Higher Education Pilot Report appeared first on TeacherMatic.

]]> 46040 TeacherMatic Further Education pilot report​ https://teachermatic.com/case_study/jisc-further-education-pilot-report/ Mon, 27 May 2024 13:47:38 +0000 https://teachermatic.com/?post_type=case_study&p=37030 TeacherMatic Further Education pilot report The TeacherMatic pilot report details a collaborative initiative by Jisc’s AI team and TeacherMatic, aimed

The post TeacherMatic Further Education pilot report​ appeared first on TeacherMatic.

]]>

TeacherMatic Further Education pilot report

The TeacherMatic pilot report details a collaborative initiative by Jisc’s AI team and TeacherMatic, aimed at reducing educators’ workload and enhancing productivity through AI-assisted tools, with positive feedback on its ease of use and time-saving benefits for further education.

three woman in front of laptop computer

Contents

This report provides a comprehensive review of TeacherMatic, detailing its initial pilot implementation, evaluation results, participant experiences, future development plans, and a summary of key findings

Introduction
Piloting TeacherMatic
TeacherMatic pilot evaluation

Participant’s experiences with TeacherMatic
TeacherMatic’s roadmap
Summary
Download report as PDF

Introduction

Jisc’s artificial intelligence team provides resources and guidance to facilitate the ethical and effective adoption of AI across the sector. A key area of the team’s work is running pilots of promising AI tools and products with Jisc members. These pilots provide members with the opportunity to gain direct experience with AI-assisted tools and the results provide valuable insights which are shared with the sector.
Female adult learners communicating during a class in lecture hall.
Young confident Middle Eastern male student talking to other learner

Piloting TeacherMatic

In April 2023, TeacherMatic was launched with the aim of reducing teachers’ workload and enhancing productivity through the use of generative artificial intelligence. The artificial intelligence team at Jisc collaborated with TeacherMatic to run a pilot programme. This initiative was designed to evaluate how the AI tool could save educators time by streamlining the creation of resources and teaching materials

What is TeacherMatic?

TeacherMatic is an AI-powered platform tailored for educators. It provides an extensive toolkit featuring more than 50 innovative tools designed to simplify the creation of educational content. These tools help in generating various teaching aids, such as lesson plans, quizzes, schemes of work and multiple choice questions, without users needing to have expertise in prompt engineering. Instead, educators can issue straightforward instructions to produce or adapt existing resources, including presentations, Word documents, and PDFs. The main goal of TeacherMatic is to enhance teaching efficiency and lighten educators’ workloads, allowing teachers more time to dedicate to student interaction and less time spent on repetitive tasks.
A webpage showcasing various educational tools and generators, including Analogy Maker, Announcement, Appraisal Questions, Assignment, and more, each with a brief description and a "Use" button.
An image of TeacherMatic’s home screen showing several generators.

Piloting institutions

The pilot aimed to trial TeacherMatic across different subject areas at different levels and evaluate the quality and level of content generated by TeacherMatic. The AI tool originally was targeted at further education (FE), therefore for our first pilot we focused on piloting with eight FE colleges. These were: Basingstoke College of Technology, Milton Keynes College, New City College, Newcastle and Stafford Colleges Group, Northampton College, NPTC Group of Colleges, Southern Regional College and West College Scotland having been chosen from over 60 applicants.

The pilot process

The pilot was divided into two distinct phases: the first phase spanned from May 2023 to June 2023, while the second phase extended from June 2023 to February 2024. Each participating institution received 50 licenses for 12 months, enabling around 400 participants to actively engage with and evaluate the
TeacherMatic platform.

Participants attended a training session designed to ensure they were able to use the tool. This session was a joint effort, collaboratively conducted by the TeacherMatic team and the Jisc team. The goal was to equip all participants with a thorough understanding of the platform’s functionalities and features, enabling
them to use TeacherMatic effectively.

African young female businesswoman student freelancer learner teacher doing homework, e-learning

Phase review process

At the end of phase one, five to ten participants from each institution took part in a focus group meeting. These meetings, held in June and July 2023, provided a forum for participants to share their experiences and insights. Then, in October 2023, all participants were invited to complete a mid-phase questionnaire. This survey aimed to gather opinions on the ease of use of the platform, identify the most frequently used features, and evaluate functions available in content generation.

In February 2024, all participants were asked to complete a second questionnaire. This survey was designed to evaluate the progress and effectiveness of the TeacherMatic platform since the beginning of the pilot. It covered participant interaction, including the frequency of use, the type and quality of content created, as well as the experiences with new features added during the pilot. The aim was to gather in depth feedback on the platform’s development and how well it met participant’s needs throughout the pilot
period.

The evaluation of phase two also included a second component: individual review meetings with the pilot lead from each institution. These sessions were designed to discuss the overall impact of the pilot and examine the processes in depth, including onboarding, staff training, and reflections on the pilot

TeacherMatic pilot evaluation

Findings from phase one

Perspectives from focus groups

Throughout the focus groups, all eight of the colleges were positive about TeacherMatic. We discussed usability, the speed of content generation compared to traditional methods, the quality of resources generated, and the time saved by using the AI tool.

In summary, feedback covered:

Positives:

  • Easy to use interface and simple to generate content
  • Useful blue icons and videos explaining how to use generators
  • Potential to help workload
  • Step by step generator was excellent
  • The sliders and Bloom’s taxonomy of learning features are useful when generating content

 

Suggested areas of improvement:

  • It would be useful to be able to store query history
  • Multiple generators in one could be useful i.e. Scheme of work and lesson plan
  • Multiple-choice question generator sometimes does not produce the answer
  • Chat generator could be slow
  • Add the duration of the lesson to the scheme of work generator

 

Ideas for new generators to add:

  • A presentation generator
  • To be able to share created content with peers directly within TeacherMatic
Screenshot of a form for generating classroom questions with fields for topic, uploaded file, number of questions, type of questions, Bloom's taxonomy levels, complexity, and output format options.
An image of Classroom Questions generator with the complexity set to high
African young female businesswoman student freelancer learner teacher doing homework, e-learning

Response to phase one feedback from TeacherMatic

After receiving feedback from the first phase of the pilot, the TeacherMatic team responded swiftly. Specific changes were implemented in response to participant suggestions, enhancing both functionality and user experience.

Implemented updates:

  • ‘It would be useful to be able to store query history’: this has now been added and users can save results
  • Multiple-choice question generator sometimes does not produce the answer’: this has been resolved
  • ‘Chat generator could be slow’: this has now greatly sped up
  • A presentation generator has been added
  • ‘To be able to share created content with peers directly within TeacherMatic’: this has been added so users can share content

Findings from phase two

Perspectives from mid-pilot questionnaire

In October 2023 we asked participants to complete a mid-phase questionnaire, this was due to the development and additions to TeacherMatic partly based on the feedback from phase one. Out of 400 participants we received 102 responses. A key point to raise at this juncture would be the possibility of
survivorship bias, in that the results may show a potential bias towards those that continued to use the tool and provided feedback against those that did not. This is something to keep in mind when considering the following.

In Summary:

  • Feedback showed that 99% of respondents were able to create content effectively
  • Participants were asked how often they use TeacherMatic; 53% weekly, 36% monthly, 3% daily, and a small group had not tried it yet
  • The most used generators were lesson plans, multiple-choice questions, scheme of work, PowerPoint, and classroom questions
  • The quality and accuracy scores were rated at 4 out of 5
  • The features like complexity levels and learning needs were rated 3.5 out of 5
  • Participants rated Bloom’s taxonomy function at 3.6 out of 5
  • 87% of the respondents reported that TeacherMatic has saved them time, while 13% indicated that it had not
  • 93% of respondents stated they would continue using the tool, while 7% said they would not
  • Participants were asked if TeacherMatic has had a positive impact on learner experience; 13% said very positive, 53% said positive, with 1% responding negative
  • 76% of respondents would recommend TeacherMatic, while 24% indicated they would not
  • A presentation generator has been added; however, feedback showed that it can generate irrelevant images and generic text
Screenshot of a multiple-choice quiz about algorithmic bias. The text includes questions and answer choices related to algorithmic bias, its impact, vulnerable groups, and strategies to address it.
An image of the results generated by the Multiple-Choice Questions generator.

Perspectives from phase two participant questionnaire

 At the end of phase two, all participants were asked to complete a questionnaire aimed to review the usability, and quality of content and to gather how much time can be saved utilising TeacherMatic over a longer period. Out of 400 participants we received 179 responses. As above, in respect of the possibility of
survivorship bias, it is worth noting we received an additional 77 responses during phase two.

In Summary:

  • Participants were asked if TeacherMatic has saved them time and 79% said yes
  • On average users said they saved two hours ten minutes per week by utilising TeacherMatic
  • Participants were asked to rate their experience using TeacherMatic for content generation in terms of ease of use; 28% said excellent, 51% said good and 21% said average
  • Feedback showed when asked about how participants would rate the accuracy of the content generated by TeacherMatic within a specific topic or subject; 16% very accurate, 69% somewhat accurate, 11% neither accurate nor inaccurate, and 4% said somewhat inaccurate
Pie chart displaying survey results on content accuracy by TeacherMatic: 69% somewhat accurate, 16% very accurate, 11% neither accurate nor inaccurate, 4% somewhat inaccurate.
A pie chart showing how accurate participants felt TeacherMatic was at generating content within a specific subject

Feedback in Summary:

  • Feedback shows that when asked to assess the overall quality of the content produced by TeacherMatic; 19% said very good, 51% good, 27% fair and 3% said poor
  • On a sliding scale of 1 to 5 stars participants were asked to rate the complexity slider based on the content generated when used, the rating average was 3.7 with 52% rating 4 stars
  • On a sliding scale of 1 to 5 stars participants were asked to rate the learner needs function on the
    content suitability generated when used, the rating average was 3.8 with 60% rating 4 stars
  • On a sliding scale of 1 to 5 stars participants were asked to rate the Bloom’s Taxonomy function on the content generated when used, the rating average was 3.8 with 40% rating 4 stars

Feedback in Summary:

  • Participants were asked which method they typically use to input information to generate content through TeacherMatic; 55% said by using keywords, 7% by using the upload a file function, 1% use the URL function, and 37% use all three. 70% of participants have used the generator filter by sector
  • 79% of participants said that they use the filter function to search for generators by sector, however, it was noted that there are now so many generators it is important to use the favourite function on the dashboard or else it can’t take time to find relevant generators
  • On average, participants gave a rating of 7.7 out of 10 on of a scale of how likely they would be to recommend TeacherMatic
  • Participants were asked if the pilot has helped to enhance their understanding of generative AI and its capabilitie;. 43% strongly agreed, 43% agreed, 11% were neutral, 2% disagreed and 1% strongly disagreed
  • 69% of participants said that TeacherMatic has helped improve learning experiences. Participants said it has helped add variety to teaching activities and delivery methods (resource ideas, quizzes, plenary activities, lesson planning and activity ideas, differentiation of learning)
Graph showing survey responses on generative AI understanding: 43% strongly agree, 43% agree, 11% neutral, 2% disagree, and 1% strongly disagree.
A pie chart showing how participating in the pilot has enhanced understanding of generative AI and its capabilities

Perspectives from pilot meetings

At the end of phase two in February 2024, we held meetings with each pilot lead to discuss their experiences and gather feedback. Our discussion began with the topic of workload reduction. All leaders agreed that TeacherMatic can help to reduce the workload for some administrative tasks and resource creation. Although they noted some important points. For instance, to fully benefit from the platform’s features, users needed to dedicate some time initially to developing content by trialling different generators and different keywords. Furthermore, it was identified that to maximise the benefits of TeacherMatic, actively sharing ideas and collaborating in content generation workshops and sessions is essential.

In our review, we looked at the onboarding process, which was generally regarded as straightforward since users could easily create an account. However, there was a suggestion that it would be beneficial for the pilot leads to have visibility into which users were actively using the tool. We also discussed how TeacherMatic was received across the institutions. The feedback was largely positive, with the majority highlighting the platform’s time-saving benefits. It was particularly noted that TeacherMatic is a valuable resource for staff new to teaching and for adapting to changes in course specifications.

Continuing our discussions, we addressed the topic of AI literacy. The consensus was that for staff with little to no understanding of generative AI, TeacherMatic has been instrumental in illustrating how AI can be a valuable tool. However, some participants fed back that they can get more innovative and engaging content from other AI chatbots when users have good prompting skills. Additionally, it was noted that some staff members had prior experience with generative AI chatbots and were proficient in creating content for teaching and learning even before the pilot began. Lastly, when discussing the cost of TeacherMatic, most participants felt that the pricing was in line with their expectations.

Participant’s experiences with TeacherMatic

Strengths of TeacherMatic

All the colleges concurred that TeacherMatic was both quick and easy to use, especially highlighting its user-friendliness for those new to AI tools. They praised the platform for its ease of use, and the results when generating content for general topics.

The quality of content produced by TeacherMatic is generally high and appropriate for the intended audience. It was noted that the prompt provided by users impacts the specificity of the generated output.

Additionally, the ability to export content in a variety of file types is good.

Areas of development

Some participants found that the learning activities generated by TeacherMatic can be repetitive.

The difficulty level of content produced by the generators is sometimes considered not challenging enough for certain more detailed subject areas.

The quality of the presentation generator is not as good as other AI tools, with large amounts of text and irrelevant images. Some participants mentioned accessibility needs when generating presentations the presentation did not generate with suitable text formats for screen readers automatically.

Some participants said TeacherMatic is easy to use, however, with the number of generators, it can be difficult to explore all generators on one screen. That said there is a favourite function, and users can search for generators by sector.

A few pilot leads suggested a dashboard feature showing individual user activity for better tracking and support.

Screenshot of a TeacherMatic webpage displaying a multiple-choice quiz question about algorithmic bias, with options to export questions to different formats and a "Save Result" button.
An image of the export options including PDF, Microsoft Word (.docx), Moodle GIFT, Kahoot, Quizizz, Blooket, Gimkit, Blackboard (.txt) Canvas (QTI).

The time-saving aspect of TeacherMatic was praised and the tool has helped to add variety and creativity within teaching and learning.

The pace of development has been rapid, now offering over 50 different generators. These have been designed to ease the workload across teaching, management, administration, and support roles.

The TeacherMatic team was proactive in responding to feedback to strengthen the platform.

TeacherMatic: the team

All colleges were very positive about the TeacherMatic team, who had provided a wealth of experience and understanding about the further education sector. The team was very quick to respond to feedback and make improvements to the platform. The initial training was praised, and the support received throughout
the pilot. TeacherMatic has built a community for its customers which looks at how to get the most from the AI tool and to share experiences, this has been well received.

 Wider perspectives of the pilot

 Colleges expressed the following benefits of participating in the pilot:

  • The pilot effectively enhanced AI literacy among staff, notably increasing their understanding of
    generative AI capabilities
  • How generative AI can help with staff workload and wellbeing
  • The potential to improve learner experiences with added variety in teaching, learning and assessment

TeacherMatic’s roadmap

Since evaluating the pilot, more generators have been added with now over 70 generators. These include additions such as “Ask Someone Famous”, “Survey Creator”, “Start of Lesson Recap”, and “Likert Survey Creator”, among many others designed to support marketing and administrative tasks.

There has been an addition to the Multiple-Choice Questions Generator which now allows users to integrate

YouTube videos directly. By copying and pasting a video link, the tool can now generate multiple-choice questions and answers based on the video content. Additionally, Microsoft Single Sign-On (SSO) has been implemented to streamline the login process.

Looking ahead there will be the introduction of a mobile app and meta generators which will combine the outputs of a number of generators from a single prompt.

Group of young asian creative business brainstorm meeting presentation, discussing roadmap to

Summary

The pilot indicates that TeacherMatic is well-suited for further education and can save users’ time. Participants commended the platform for its ease of use, efficient content generation, and benefits to workload. Feedback also highlighted areas for improvement and new feature suggestions which the TeacherMatic team were very quick to take on board and where possible, implement.

Participants found TeacherMatic to be user-friendly, particularly praising its easy-to-use interface and simple content generation process. The platform was noted for its instructional icons, videos, and features such as Bloom’s taxonomy, which assists in creating educational content efficiently. However, suggestions
for enhancements include the ability to integrate multiple functionalities into single generators. It also remains essential for users to evaluate the generated content, ensuring it is suitable and accessible to the
intended audience.

This is a great product. I have been experimenting with this and chat GPT, it's even come up with topics I had missed out in the curriculum and ideas for active learning I had not considered.

Dawn Buzzard - YellowBrick Learning Tweet

TeacherMatic was well-received across institutions, for its capabilities, especially beneficial for new teaching staff and those adapting to changing course specifications. It also improved AI literacy among staff, particularly valuable for those previously unfamiliar with generative AI, while those with prior experience found it useful for creating teaching content. Pricing was generally seen as reasonable, aligning with most participants’ expectations. TeacherMatic has been well-received, with a majority of participants recognising its benefits and expressing a willingness to continue using and recommending the tool.

The post TeacherMatic Further Education pilot report​ appeared first on TeacherMatic.

]]> 37030