Is it possible to set up a winkModel (using the wink-eng-lite-web-model) in a Worker?
#68
-
|
I'm trying to set up a web worker to handle some nlp stuff. I've tried a few different approaches, but I always end up getting this error: Pointing to this section of code: I've tried importing wink in different ways, but I don't think that's the issue. I've also configured esbuild to bundle it for This worker code should reproduce the error: self.onmessage = async function (e) {
const model = require("wink-eng-lite-web-model");
const wink = require("wink-nlp");
const winkModel = wink(model);
self.postMessage(e.data);
}; |
Beta Was this translation helpful? Give feedback.
Replies: 6 comments 20 replies
-
|
Have you considered requiring the package outside the function? |
Beta Was this translation helpful? Give feedback.
-
|
Yes, importing at the top of the script gives the same error |
Beta Was this translation helpful? Give feedback.
-
|
See if this gives you any clue: https://observablehq.com/@winkjs/how-to-run-wink-nlp-on-observable?collection=@winkjs/winknlp-recipes |
Beta Was this translation helpful? Give feedback.
-
|
This works! |
Beta Was this translation helpful? Give feedback.
-
|
You can use |
Beta Was this translation helpful? Give feedback.
-
|
But I would still need to fetch it from a remote. |
Beta Was this translation helpful? Give feedback.
-
|
Can't this module use an |
Beta Was this translation helpful? Give feedback.
-
|
That might not be the cause of the issue. But basically, if the web-model fetched from the skypack remote works, but the local version doesn't, then something must be different |
Beta Was this translation helpful? Give feedback.
-
|
In that case simply browserify your worker and it should work: nlp-main.jsconst winkNLP = require( 'wink-nlp' );
const model = require( 'wink-eng-lite-web-model' );
const nlp = winkNLP( model )
onmessage = function ( e ) {
const message = nlp.readDoc(e.data).tokens().out();
console.log(`[From Main (Text)]: ${e.data}`);
postMessage(JSON.stringify(message));
};The above file should be browserify using following command: browserify nlp-main.js -o nlp.js |
Beta Was this translation helpful? Give feedback.
-
|
Haha then I get this problem:
|
Beta Was this translation helpful? Give feedback.
-
|
Please see above updated reply, there is no export. |
Beta Was this translation helpful? Give feedback.
-
|
Giving the entire code again for you: index.html<html lang="en">
<head>
<title>Web Workers Demo</title>
<meta charset="UTF-8" />
</head>
<body>
<div id="app"></div>
<h1>Web Workers Demo with Browserify — Basic NLP</h1>
<script src="main.js"></script>
</body>
</html>nlp-main.jsconst winkNLP = require( 'wink-nlp' );
const model = require( 'wink-eng-lite-web-model' );
const nlp = winkNLP( model )
onmessage = function ( e ) {
const message = nlp.readDoc(e.data).tokens().out();
console.log(`[From Main (Text)]: ${e.data}`);
postMessage(JSON.stringify(message));
};main.jsconst worker = new Worker("nlp.js" );
worker.onmessage = e => {
const message = e.data;
console.log(`[From Worker (Tokens)]: ${message}`);
};
worker.postMessage("Hello World!");
worker.postMessage("Hi how are you!");Browserify using the following command: browserify nlp-main.js -o nlp.jsHere is the screenshot: |
Beta Was this translation helpful? Give feedback.
-
|
I see, I see. |
Beta Was this translation helpful? Give feedback.
-
|
I have marked it as the answer. |
Beta Was this translation helpful? Give feedback.
-
|
I tried to get the raw js from the remote skypack, but this url doesn't show the code: https://cdn.skypack.dev/pin/[email protected]/mode=imports,min/optimized/wink-eng-lite-web-model.js Do you know if I can just copy the remote code into my local file? |
Beta Was this translation helpful? Give feedback.
-
|
Why not use the |
Beta Was this translation helpful? Give feedback.
-
|
There are lots of issues in trying to use the browserified worker in the context of the app I'm working in. |
Beta Was this translation helpful? Give feedback.
-
|
I guess best is to lookup skypack documentation or ask them... |
Beta Was this translation helpful? Give feedback.
-
|
We have release a new version of our Hope it helps you further. |
Beta Was this translation helpful? Give feedback.
-
|
Thanks for the ping @sanjayaksaxena :D |
Beta Was this translation helpful? Give feedback.
In that case simply browserify your worker and it should work:
nlp-main.js
The above file should be browserify using following command: