Creative Vector Drawing Generation

Abstract:

Sketch is a powerful communication tool naturally embedded in humans, allowing the expression of complex ideas through relatively simple forms. Unlike raster images, which are dense grid-based representations captured by cameras or sensors, human sketches should be treated as inherently different, more abstract data structures. In this work, we explore and develop sketch-based generation frameworks as vector drawing format that better emulate the human creative process. These representations not only capture the essence of hand-drawn sketches but also provide beneficial properties for digital applications, such as scalability and semantic manipulation.

The motivation for this research is twofold: (i) to emphasise the intrinsic creativity of human sketches and the importance of strokes in creative vector drawing generation tasks, and (ii) to develop vector-based sketch generation models that enhance 2D and 3D digital workflows for both artists and non-experts. We develop a stroke-based sketch classifier to demonstrate the role of strokes in a preliminary study. Next, we propose and explore creative vector drawing generation models at both 2D and 3D levels. These models are more creative in their design than existing methods and exhibit desirable features for downstream tasks such as abstraction, recreation, and correction. We also highlight several practical applications of these models, including semantic editing, sketch healing, and structural recreation, showcasing their potential in design, art and other creative fields.

The contributions of this thesis are multifaceted: it advances the field of AI-driven creative vector drawing generation, proposes new methodologies for integrating more flexibility and conditions into sketch generative processes, and offers practical tools that can be applied across a wide range of creative disciplines. The work culminates in a vision of a future where AI plays a central role in expanding the possibilities of artistic expression, making sketch -- a complex and abstract form of art accessible to all.