ImageCapture polyfill

ImageCapture is a polyfill for the MediaStream Image Capture API.

Status

As of June 2017, the ImageCapture spec is relatively stable. Chrome supports the API starting with M59 (earlier versions require setting a flag) and Firefox has partial support behind a flag. See the ImageCapture browser support page for details.

Prior art

Prior to this API, in order to take a still picture from the device camera, two approaches have been used:

1. Set the source of a
   element to a stream obtained via

   navigator[.mediaDevices].getUserMedia

   , then use a 2D canvas context to

   drawImage

   from that video. The

   canvas

   can return a URL to be used as the

   src

   attribute of an
   element, via

   .toDataURL('image/')

   . (1, 2)
2. Use the HTML Media Capture API, i.e.

Demo

The demo currently shows grabFrame() and takePhoto().

Quick start

yarn add image-capture

Or, with npm:

npm install --save image-capture

In your JS code:

let videoDevice;
let canvas = document.getElementById('canvas');
let photo = document.getElementById('photo');

navigator.mediaDevices.getUserMedia({video: true}).then(gotMedia).catch(failedToGetMedia);
function gotMedia(mediaStream) {
  // Extract video track.
  videoDevice = mediaStream.getVideoTracks()[0];
  // Check if this device supports a picture mode...
  let captureDevice = new ImageCapture(videoDevice);
  if (captureDevice) {
    captureDevice.takePhoto().then(processPhoto).catch(stopCamera);
    captureDevice.grabFrame().then(processFrame).catch(stopCamera);
  }
}
function processPhoto(blob) {
  photo.src = window.URL.createObjectURL(blob);
}
function processFrame(imageBitmap) {
  canvas.width = imageBitmap.width;
  canvas.height = imageBitmap.height;
  canvas.getContext('2d').drawImage(imageBitmap, 0, 0);
}
function stopCamera(error) {
  console.error(error);
  if (videoDevice) videoDevice.stop();  // turn off the camera
}
photo.addEventListener('load', function () {
  // After the image loads, discard the image object to release the memory
  window.URL.revokeObjectURL(this.src);
});

Methods

Start by constructing a new ImageCapture object:

let captureDevice;

navigator.mediaDevices.getUserMedia({video: true}).then(mediaStream => {
  captureDevice = new ImageCapture(mediaStream.getVideoTracks()[0]);
}).catch(...)

Please consult the spec for full detail on the methods.

constructor(videoStreamTrack)

Takes a video track and returns an ImageCapture object.

getPhotoCapabilities

TBD

setOptions

TBD

takePhoto

Capture the video stream into a Blob containing a single still image.

Returns a Promise that resolves to a Blob on success, or is rejected with

DOMException

captureDevice.takePhoto().then(blob => {

}).catch(error => ...);

grabFrame

Gather data from the video stream into an ImageBitmap object. The width and height of the ImageBitmap object are derived from the constraints of the video stream track passed to the constructor.

Returns a Promise that resolves to an ImageBitmap on success, or is rejected with

DOMException

captureDevice.grabFrame().then(imageBitmap => {

}).catch(error => ...);

Compatibility

The polyfill has been tested to work in current browsers:

• Chrome 55+
• Firefox 49+
• Chrome 52+ for Android
• Firefox 48+ for Android

For the widest compatibility, you can additionally load the WebRTC adapter. That will expand support to:

• Chrome 53

For older browsers that don't support navigator.getUserMedia, you can additionally load Addy Osmani's shim with optional fallback to Flash - getUserMedia.js. Alternatively, the getUserMedia wrapper normalizes error handling and gives an error-first API with cross-browser support.

Development

yarn

yarn
yarn run dev

npm

npm install
npm run dev

To make your server accessible outside of

localhost

run lt

Before committing, make sure you pass yarn/npm

run lint

run docs