Jake Swiatek — Creative Technologist

Jake Swiatek

Creative Technologist

I build the things that don't have a template yet — LLM-backed tools, trained vision models, games, audio experiments, voice skills and 3D on the web. As Associate Director of Technology and Innovation at VML in New York, I also spend a lot of time on custom business solutions, internal software, and helping other engineers figure out the hard stuff. Because client campaigns move fast and enterprise tools stay behind NDAs, this site is a home for my favorite public builds and experiments.

Based
New York, NY
Selected work
6 projects
Status
Open to interesting problems

Experience

  1. VML

    Associate Director of Technology and Innovation / Senior Fullstack Developer

    2019—Present · New York, NY

  2. TracyLocke

    Sr. XR Developer / Lead Front End Developer

    2012—2019 · Wilton, CT

  3. Freelance

    Web Developer / Software Engineer / UX Designer

    2010—Present · Remote

Capabilities

AI & ML
Amazon Bedrock, LLM Integration, Guardrails, Prompt Engineering, TensorFlow.js, Model Training, Computer Vision
Languages
TypeScript, JavaScript, C#, C++, .NET, Python, HTML, SCSS
Frameworks
Angular, React, Node, NestJS, Ionic, RxJS
Data
PostgreSQL, DynamoDB, SQL
Realtime & 3D
three.js, Unity3D, Unreal, Babylon.js, Pixi.js, ARKit, ARcore, Lens Studio, Spark AR, 8th Wall
Platforms
AWS, Heroku, Amazon Alexa, Git, Xcode, Android Studio
Design
Adobe Creative Suite, Cinema 4D, Blender, 3ds Max, Figma

Selected Projects

6 entries

Sour Translator

Sour Patch Kids · VML · 2024

Sour Translator project thumbnail
Role
Lead Developer
Type
Web App / Chrome Extension

I built a library of common corporate jargon, then a web app that translates recognized phrases to uncover their alternate meanings — plus a companion Manifest V3 Chrome extension that works inline with Outlook and Gmail.

  • Angular
  • Chrome Extension
  • NestJS
  • PostgreSQL

Read the coverage — Sour Translator

Name This Oreo

Mondelez International · VML · 2024

Name This Oreo project thumbnail
Role
Lead Developer
Type
Web App

A voice game built around the cookie's name. Each round stacks a random Oreo — cookies are 'oh', creme layers are 're' — and the player has to say the whole thing back, taking penalties for slips and earning better badges the further they get. It all had to run in the browser in real time, so a custom-trained model scores the pronunciation on TensorFlow.js while the Web Audio API captures and analyzes the mic input.

  • Angular
  • TensorFlow.js
  • three.js
  • NestJS
  • PostgreSQL

Case study — Name This Oreo

Baileys Sound Scales

Baileys · VML · 2023

Baileys Sound Scales project thumbnail
Role
Lead Developer
Type
Web App

A web app that works out how much Baileys is left in the brand's famously opaque bottle from the tone you get blowing across the top — the bottle acts as a Helmholtz resonator, so the pitch tracks the volume left inside. It then serves recipes and offers matched to what's remaining.

  • Web Audio API
  • NestJS
  • PostgreSQL

Case study — Baileys Sound Scales

Lucky's Charmology

Lucky Charms · VML · 2023

Lucky's Charmology project thumbnail
Role
Lead Developer
Type
Web App

A web app built on a TensorFlow.js model trained to recognize the arrangement of marshmallows in a bowl of cereal, paired with influencers running live astrology-style readings.

  • Angular
  • TensorFlow.js
  • NestJS
  • PostgreSQL

Case study — Lucky's Charmology

I See Coke

Coca-Cola · VML · 2022

I See Coke project thumbnail
Role
Lead Developer
Type
Alexa Skill

A bilingual English and Arabic Alexa skill. Spot a Coke in a film or TV show, tell Alexa, and a redemption code for a free one arrives over SMS.

  • Alexa Skills Kit
  • Lambda
  • DynamoDB
  • S3
  • SNS

Case study — I See Coke

Tecate AR Boxing

Tecate · TracyLocke · 2018

Tecate AR Boxing project thumbnail
Role
Lead Developer / Game Designer / 3D Artist
Type
iOS / Android App

An AR boxing game built in Unity3D for iOS and Android. Scanning any Tecate product started a match, and ARKit and ARCore anchored a virtual punching bag in the player's own space — each round harder than the last.

  • Unity3D
  • C#
  • ARKit
  • ARCore
  • Xcode
  • Android Studio

Watch the hype video — Tecate AR Boxing

Contact

jakeswi@proton.me