Handiness Hand

Repo for a R&D experiment on real-time handtracking on the web using Google's Mediapipe solution.

• Get started
• Building and running in production mode
• Single-page app mode
• Notes

Get started

Install the dependencies...

cd handiness
npm install

...then start Rollup:

npm run dev

Navigate to localhost:5000. You should see your app running. Edit a component file in src, save it, and reload the page to see your changes.

By default, the server will only respond to requests from localhost. To allow connections from other computers, edit the sirv commands in package.json to include the option --host 0.0.0.0.

If you're using Visual Studio Code we recommend installing the official extension Svelte for VS Code. If you are using other editors you may need to install a plugin in order to get syntax highlighting and intellisense.

Building and running in production mode

To create an optimised version of the app:

npm run build

You can run the newly built app with npm run start. This uses sirv, which is included in your package.json's dependencies so that the app will work when you deploy to platforms like Heroku.

Single-page app mode

By default, sirv will only respond to requests that match files in public. This is to maximise compatibility with static fileservers, allowing you to deploy your app anywhere.

If you're building a single-page app (SPA) with multiple routes, sirv needs to be able to respond to requests for any path. You can make it so by editing the "start" command in package.json:

"start": "sirv public --single"

Notes

At time of writing, only supporting WebGL2 supporting devices, due to Mediapipe support. Noted to support Safari (WebGL1) somewhere this year(2021).

Trivia on MediaPipe

• JS documentation is still quite barebones
• There are NPM packages
  • These packages are to be imported globally
  • You'll need to extract scripts from the package manually (@mediapipe/hands)
  • See initMediaHands.js