In January Microsoft Garage announced a new project called “Sketch 2 Code” which will help developers to easily move from prototyping to real development. With Sketch 2 Code, developers can draw wire frame sketches and export them into source code. Sketch 2 Code uses artificial intelligence and automation to develop code from wire frame sketches. For now, Sketch 2 Code will only support basic app visual elements including labels, text fields, text paragraphs, images, and buttons.
The model behind this service has been trained with millions of images and enables object detection for a wide range of types of objects. With this information Microsoft can generate the HTML snippets of the different elements in the design, and then can infer the layout of the design from the position of the identified elements and generate the final HTML code accordingly.
Developers can try out Sketch 2 Code right now at Microsoft here.