Playground

The configuration is a YAML array of steps.

• write -- takes an optional color (string), size (number)
• screenshot-cropped -- takes an optional name
• screenshot-full -- takes an optional name
• screenshot-selection -- takes an optional name
• measure-selection -- takes an optional name; saves it as "minX,minY,maxX,maxY"
• measure-area -- does not snap to eleemnts; takes an optional name; saves it as "minX,minY,maxX,maxY"
• pointer -- takes an optional name, color (string), radius (number); saves the point as {x: number, y: number}
• remove-elements -- takes types, an array of the element types to remove ('stroke', 'pointer', 'image')
• text -- takes a required name, lets the user input a value as a string
• number -- takes a required name, lets the user input a value as a number
• number -- takes a required name, optional label; lets the user input a value as a checkbox

All steps support an optional description.

Note that coordinates for measurements and pointers are relative to the last screenshot taken, using Gemini's 0-1000 coordinates. Alternatively if there was no previous screenshot, they are absolute coordinates to the canvas.

Example:

- type: write
  description: Write a note containing an equation
- type: screenshot-cropped
  name: canvas
- type: measure-selection
  name: equation
  description: Select the equation
- type: measure-selection
  name: equals
  description: Select the equals sign