VS Code Extension for Children
Defining the scope and specifications of our VS Code extension for children's game development
The world of digital creation is increasingly accessible, yet many children, eager to express their creativity through game development, face significant hurdles. The complexity of modern game engines and the overwhelming array of programming concepts can be daunting, leading to frustration and a sense of inadequacy. This lack of accessible guidance and intuitive tools often stifles the potential for young minds to explore and develop their technical and artistic skills.
Recognizing this gap, our team has developed PixelPilot, an AI-powered copilot designed to empower children to create their own games with ease. PixelPilot aims to demystify the game development process by providing a user-friendly, conversational interface that guides children through every stage of creation. By leveraging advanced AI capabilities, PixelPilot can generate all the necessary code, assets, and resources, effectively eliminating the technical barriers that often hinder young creators.
PixelPilot is envisioned as a personalized creative companion that allows children to focus on their imagination rather than complex technical details. It should enable them to:
Conceptualize and design games through simple, natural language interactions
Generate all required code snippets and scripts automatically, eliminating the need for extensive programming knowledge
Create custom game assets, including sprites, and backgrounds, through AI-driven generation
Receive real-time suggestions, fostering a learning environment that encourages experimentation and creativity
Ultimately, PixelPilot seeks to make game development accessible to children of all backgrounds, fostering a new generation of digital creators and empowering them to bring their imaginative worlds to life.
After understanding the Project Background, we scheduled an online meeting with our client, Mr. Christoffer Noring from Microsoft. This meeting helped us understand the main requirements of the project and what exactly do our clients need from us. These are the basic requirements that our clients wanted:
Visual Studio Code Extension built on top of Github Copilot
Game Logic Assistance
Content Moderation for classroom safety
Our aim is to develop a Visual Studio Code extension that can be downloaded directly from the Visual Studio Marketplace and run on a wide range of operating systems. This extension should bundle children friendly features and be easily extensible to support new models in the future. We hope this extension makes a young game developer's journey exciting and accessible while also improving their skills which is important in the longer run.
We knew that in order to create something truly beneficial, we needed to know what our users truly needed. We began by considering who they might be and what they might want rather than merely speculating. In order to truly listen to and learn from them, this assisted us in coming up with some insightful interview and survey questions. Due to the legal and ethical constraints of the project, we could not interview children. Hence, we decided to conduct semi-structured interviews on individuals (Parents and Headteachers) that would buy the product for our target users. By using semi-structured interviews, we were able to explore particular subjects in depth and, more importantly, to ask for more specific information whenever a user's response indicated that more research was required. These are the general results of the interviews we conducted:
Many parents mentioned that their children are excited by the idea of combining creativity and logic. Some want to build games like Minecraft to impress their friends or gain recognition, while others simply enjoy the satisfaction of creating something interactive from scratch.
A common reason cited was the lack of programming experience. Game engines can appear too complicated or intimidating, especially for younger learners. Parents noted that without guidance, their children often feel overwhelmed trying to navigate these tools on their own.
Parents expressed a strong interest in having a learning assistant—ideally one that could offer help when their child gets stuck. Whether AI-based or human, an accessible and interactive mentor would be highly beneficial, especially one that could teach programming concepts in a practical, game-oriented way.
Games are what children are interested in nowadays. I want to use it to introduce students to coding, as a way of meeting the needs of the digital age.
Yes, I want to make sure that all interactions are safe, age appropriate, and educational.
I want my students to be able to explore their own interests and passions, and I want to expose them to all the career opportunities associated with programming.
In order to better understand our target users' needs, goals, and requirements, we developed personas and scenarios based on the interview results.
Bart is a young boy trying to get into game development, his main motivation for doing so being that he wants to impress his friends and create a game as popular as Minecraft. He uses VS Code, the most widely-used code editor to write code for his game logic. Within VS Code he uses our extension to help him create assets, textures and code for the game logic. Bart is a novice and so needs all processes to be as streamlined as possible to facilitate easy game development, and to help him learn what's important. Bart loved using the visualiser as it enabled him to quickly see what was happening in the game, and the effects his code changes were having.
Emma is a student that loves to delve into complex software problems and challenge herself by tackling intricate coding puzzles. She is fascinated by the intersection of creativity and logic in game development and has used our tool as a resource for learning about game development and also to more easily facilitate the development process. She now knows the fundamentals of game development such as assets and object-oriented code, and is currently using this to develop her own game, from scratch - one of her many aspirations.
Based on the requirements and goals of the project, we have identified several key use cases that our extension should support. These use cases outline the primary interactions and functionalities that PixelPilot will provide to its users.
> LOADING USE CASE TABLE...
| ID | Actors | Use Case | Result |
|---|---|---|---|
| UC1 | User | Initiate Walkthrough | The extension generates and saves the basic code files and assets required to make the game that the user wants. This helps children narrow down on what game they want to develop (works both online and offline). |
| UC2 | User | Ask any question | Our chat participant uses the selected AI Model to deliver an answer to the prompt. This is possible as our chat participant is built on top of Copilot. |
| UC3 | User | Change Chat Completion Model | The model used for replying in the chat is changed to the selected model. |
| UC4 | Users | Change Code Generation Model | The model used for generating code is changed to the selected model. |
| UC5 | User | Change Mastery Level | The mastery used for replying to prompts is changed to the selected model. |
| UC6 | User | Generate an Image | If the current directory does not have an assets folder, the folder is made and an images folder is made inside the assets folder. The selected image is saved within this images folder. |
| UC7 | User | Replace an Image | Our extension checks if the image you want to replace does not exist, if not it will just save the selected new image in the assets/images/ folder. If the image you want to replace exists, it will delete this older image, save the new image in the assets/images/ folder and go through all your code files and replace the code so that now the code uses the new image’s destination instead of the older image’s destination. |
| UC8 | User | Explain basic coding fundamental concepts | A window pops up with the basic coding fundamental concepts used in the code and their basic explanations. It also provides 3 youtube video links to explain each fundamental concept visually. |
> USE CASE LOADED SUCCESSFULLY
> CLICK ON A ROW TO SEE MORE INFORMATION ON THE USE CASE
Game Logic Assistant
Real-time, Context-aware Suggestions
Platform Support
Image Asset Generation
Pre-built Templates and Demonstrators
Beginner-Friendly Tutorials
Output Validation
Advanced Real-Time Suggestions
Live Game Viewer
Voice Accessibility Support
LM Model Options
Generative Special Effects
Content Moderation
Discover the research that informed our requirements and shaped the development of Pixel Pilot.