T0b1/wasmtime
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity

Add an initial wasi-nn implementation for Wasmtime (#2208)

Browse Source 
* Add an initial wasi-nn implementation for Wasmtime

This change adds a crate, `wasmtime-wasi-nn`, that uses `wiggle` to expose the current state of the wasi-nn API and `openvino` to implement the exposed functions. It includes an end-to-end test demonstrating how to do classification using wasi-nn:
 - `crates/wasi-nn/tests/classification-example` contains Rust code that is compiled to the `wasm32-wasi` target and run with a Wasmtime embedding that exposes the wasi-nn calls
 - the example uses Rust bindings for wasi-nn contained in `crates/wasi-nn/tests/wasi-nn-rust-bindings`; this crate contains code generated by `witx-bindgen` and eventually should be its own standalone crate

* Test wasi-nn as a CI step

This change adds:
 - a GitHub action for installing OpenVINO
 - a script, `ci/run-wasi-nn-example.sh`, to run the classification example
This commit is contained in:
Andrew Brown
2020-11-16 10:54:00 -08:00
committed by GitHub
parent 61a0bcbdc6
commit a61f068c64
33 changed files with 1554 additions and 1 deletions
Download Patch File Download Diff File Expand all files Collapse all files

29
crates/wasi-nn/Cargo.toml Normal file
View File

@@ -0,0 +1,29 @@
[package]
name = "wasmtime-wasi-nn"
version = "0.21.0"
authors = ["The Wasmtime Project Developers"]
description = "Wasmtime implementation of the wasi-nn API"
documentation = "https://docs.rs/wasmtime-wasi-nn"
license = "Apache-2.0 WITH LLVM-exception"
categories = ["wasm", "computer-vision"]
keywords = ["webassembly", "wasm", "neural network"]
repository = "https://github.com/bytecodealliance/wasmtime"
readme = "README.md"
edition = "2018"
[dependencies]
# These dependencies are necessary for the witx-generation macros to work:
anyhow = "1.0"
log = { version = "0.4", default-features = false }
wasmtime = { path = "../wasmtime", version = "0.21.0", default-features = false }
wasmtime-runtime = { path = "../runtime", version = "0.21.0" }
wasmtime-wiggle = { path = "../wiggle/wasmtime", version = "0.21.0" }
wasmtime-wasi = { path = "../wasi", version = "0.21.0" }
wiggle = { path = "../wiggle", version = "0.21.0" }
# These dependencies are necessary for the wasi-nn implementation:
openvino = "0.1.5"
thiserror = "1.0"
[badges]
maintenance = { status = "experimental" }