Merge remote-tracking branch 'upstream/master' into record-tuple

# Conflicts:
#	graal-js/src/com.oracle.js.parser/src/com/oracle/js/parser/TokenType.java
#	graal-js/src/com.oracle.truffle.js.parser/src/com/oracle/truffle/js/parser/GraalJSTranslator.java
#	graal-js/src/com.oracle.truffle.js/src/com/oracle/truffle/js/nodes/access/ReadElementNode.java
#	graal-js/src/com.oracle.truffle.js/src/com/oracle/truffle/js/nodes/control/DeletePropertyNode.java

Author: christianaistleitner

3rd_party_licenses.txt

@@ -931,7 +931,7 @@ THE POSSIBILITY OF SUCH DAMAGE.
 
 ================================================================================
 
-Node.js 12.20.1
+Node.js 14.16.1
 
 Node.js is licensed for use as follows:
 
@@ -988,6 +988,8 @@ The externally maintained libraries used by Node.js are:
 
 - Acorn, located at deps/acorn, is licensed as follows:
   """
+    MIT License
+
     Copyright (C) 2012-2018 by various contributors (see AUTHORS)
 
     Permission is hereby granted, free of charge, to any person obtaining a copy
@@ -1049,29 +1051,6 @@ The externally maintained libraries used by Node.js are:
     purpose.  It is provided "as is" without express or implied warranty.
   """
 
-- HTTP Parser, located at deps/http_parser, is licensed as follows:
-  """
-    Copyright Joyent, Inc. and other Node contributors.
-
-    Permission is hereby granted, free of charge, to any person obtaining a copy
-    of this software and associated documentation files (the "Software"), to
-    deal in the Software without restriction, including without limitation the
-    rights to use, copy, modify, merge, publish, distribute, sublicense, and/or
-    sell copies of the Software, and to permit persons to whom the Software is
-    furnished to do so, subject to the following conditions:
-
-    The above copyright notice and this permission notice shall be included in
-    all copies or substantial portions of the Software.
-
-    THE SOFTWARE IS PROVIDED "AS IS", WITHOUT WARRANTY OF ANY KIND, EXPRESS OR
-    IMPLIED, INCLUDING BUT NOT LIMITED TO THE WARRANTIES OF MERCHANTABILITY,
-    FITNESS FOR A PARTICULAR PURPOSE AND NONINFRINGEMENT. IN NO EVENT SHALL THE
-    AUTHORS OR COPYRIGHT HOLDERS BE LIABLE FOR ANY CLAIM, DAMAGES OR OTHER
-    LIABILITY, WHETHER IN AN ACTION OF CONTRACT, TORT OR OTHERWISE, ARISING
-    FROM, OUT OF OR IN CONNECTION WITH THE SOFTWARE OR THE USE OR OTHER DEALINGS
-    IN THE SOFTWARE.
-  """
-
 - cjs-module-lexer, located at deps/cjs-module-lexer, is licensed as follows:
   """
     MIT License
@@ -2017,6 +1996,7 @@ The externally maintained libraries used by Node.js are:
 
 - GYP, located at tools/gyp, is licensed as follows:
   """
+    Copyright (c) 2020 Node.js contributors. All rights reserved.
     Copyright (c) 2009 Google Inc. All rights reserved.
 
     Redistribution and use in source and binary forms, with or without

CHANGELOG.md

@@ -3,12 +3,21 @@
 This changelog summarizes major changes between GraalVM versions of the GraalVM JavaScript (ECMAScript) language runtime.
 The main focus is on user-observable behavior of the engine.
 
+## Version 21.2.0
+* Graal.js now prints a warning when runtime compilation is not supported. This warning can be disabled using the '--engine.WarnInterpreterOnly=false' option or the '-Dpolyglot.engine.WarnInterpreterOnly=false' system property.
+* Added the `js.unhandled-rejections` option to track unhandled promise rejections in a polyglot `Context`. By default, the option is set to `none`, and unhandled promise rejections are not tracked.
+* Implemented the [New Set Methods](https://github.com/tc39/proposal-set-methods) proposal. It is available behind an experimental flag (`--js.new-set-methods`).
+
 ## Version 21.1.0
+* Updated Node.js to version 14.16.1.
 * Prototype of WebAssembly JavaScript Interface implemented. It is available behind the `--js.webassembly` flag.
 * Implemented iterator interop support, enabling foreign objects that have an iterator to be used where JS expects iterables, as well as JS iterables to be used in other languages and via the [Value](https://www.graalvm.org/sdk/javadoc/org/graalvm/polyglot/Value.html#getIterator--) API.
 * Adopted new buffer interop support, allowing foreign buffers to be used with typed arrays and `DataView`, without copying. Likewise enables `ArrayBuffer` to be used in other languages.
 * Experimental option `js.array-sort-inherited` was removed. Values visible through holes in array(-like) object are always sorted according to the latest version of ECMAScript specification.
 * Updated ICU4J library to version 68.2.
+* Implemented the [Atomics.waitAsync](https://github.com/tc39/proposal-atomics-wait-async) proposal. It is available in ECMAScript 2022 mode (`--js.ecmascript-version=2022`).
+* Implemented hash map interop support. Allows foreign hash maps to be iterated using `for in/of` loops, `new Map(hash)`, `Array.from(hash)`, etc. If the `--js.foreign-hash-properties` option is enabled (default), foreign hash maps can also be accessed using `hash[key]`, `hash.key`, and used in `{...hash}`. If the `--js.foreign-object-prototype` option is enabled, foreign hash maps also have `Map.prototype` methods.
+* Moved GraalVM-Node.js to a separate installable component. In a GraalVM distribution it needs to be manually installed with `$GRAALVM/bin/gu install nodejs`.
 
 ## Version 21.0.0
 * ECMAScript 2021 mode/features enabled by default.

README.md

@@ -41,12 +41,21 @@ New features, e.g. `ECMAScript proposals` scheduled to land in future editions,
 
 In addition, some popular extensions of other engines are supported, see [`JavaScriptCompatibility.md`](https://github.com/graalvm/graaljs/tree/master/docs/user/JavaScriptCompatibility.md).
 
+### Node.js support
+
 GraalVM JavaScript can execute Node.js applications.
 It provides high compatibility with existing npm packages, with high likelyhood that your application will run out of the box.
 This includes npm packages with native implementations.
 Note that some npm modules will require to be re-compiled from source with GraalVM JavaScript if they ship with binaries that have been compiled for Node.js based on V8.
 Node.js support is only available in full GraalVM releases, but not in the `standalone` GraalVM JavaScript distribution.
 
+Since GraalVM 21.1, the Node.js support is packaged as a separate component that can be installed using the _GraalVM Updater_:
+
+```shell
+$ $GRAALVM/bin/gu install nodejs
+$ $GRAALVM/bin/node --version
+```
+
 ### Compatibility on Operating Systems
 
 The core JavaScript engine is a Java application and is thus in principle compatible with every operating system that provides a compatible JVM, [see `RunOnJDK.md`](https://github.com/graalvm/graaljs/tree/master/docs/user/RunOnJDK.md).

ci.jsonnet

@@ -6,7 +6,7 @@ local common = import 'common.jsonnet';
   // Used to run fewer jobs
   local debug = false,
 
-  local overlay = 'bbf690a852d1b13508d41437c5a5566d6f8f963e',
+  local overlay = '886aca6f23b314483bf8ff1e6b889d008aa8236a',
 
   local no_overlay = 'cb733e564850cd37b685fcef6f3c16b59802b22c',
 

common.json

@@ -2,20 +2,20 @@
   "README": "This file contains definitions that are useful for the hocon and jsonnet CI files of multiple repositories.",
 
   "jdks": {
-    "openjdk8":           {"name": "openjdk",   "version": "8u292+05-jvmci-21.1-b02", "platformspecific": true },
-    "oraclejdk8":         {"name": "oraclejdk", "version": "8u291+07-jvmci-21.1-b02", "platformspecific": true },
-    "oraclejdk8Debug":    {"name": "oraclejdk", "version": "8u291+07-jvmci-21.1-b02-fastdebug", "platformspecific": true },
+    "openjdk8":           {"name": "openjdk",   "version": "8u292+09-jvmci-21.1-b05", "platformspecific": true },
+    "oraclejdk8":         {"name": "oraclejdk", "version": "8u291+10-jvmci-21.1-b05", "platformspecific": true },
+    "oraclejdk8Debug":    {"name": "oraclejdk", "version": "8u291+10-jvmci-21.1-b05-fastdebug", "platformspecific": true },
 
     "openjdk11":          {"name": "openjdk",   "version": "11.0.3+7", "platformspecific": true },
     "oraclejdk11":        {"name": "oraclejdk", "version": "11.0.6+8", "platformspecific": true },
-    "labsjdk-ce-11":      {"name": "labsjdk",   "version": "ce-11.0.11+5-jvmci-21.1-b02", "platformspecific": true },
-    "labsjdk-ee-11":      {"name": "labsjdk",   "version": "ee-11.0.11+5-jvmci-21.1-b02", "platformspecific": true },
+    "labsjdk-ce-11":      {"name": "labsjdk",   "version": "ce-11.0.11+8-jvmci-21.1-b05", "platformspecific": true },
+    "labsjdk-ee-11":      {"name": "labsjdk",   "version": "ee-11.0.11+9-jvmci-21.1-b05", "platformspecific": true },
 
     "oraclejdk16":        {"name": "oraclejdk", "version": "16.0.1+4", "platformspecific": true },
-    "labsjdk-ce-16":      {"name": "labsjdk",   "version": "ce-16+36-jvmci-21.1-b02", "platformspecific": true },
-    "labsjdk-ce-16Debug": {"name": "labsjdk",   "version": "ce-16+36-jvmci-21.1-b02-debug", "platformspecific": true },
-    "labsjdk-ee-16":      {"name": "labsjdk",   "version": "ee-16+36-jvmci-21.1-b02", "platformspecific": true },
-    "labsjdk-ee-16Debug": {"name": "labsjdk",   "version": "ee-16+36-jvmci-21.1-b02-debug", "platformspecific": true }
+    "labsjdk-ce-16":      {"name": "labsjdk",   "version": "ce-16.0.1+9-jvmci-21.1-b05", "platformspecific": true },
+    "labsjdk-ce-16Debug": {"name": "labsjdk",   "version": "ce-16.0.1+9-jvmci-21.1-b05-debug", "platformspecific": true },
+    "labsjdk-ee-16":      {"name": "labsjdk",   "version": "ee-16.0.1+9-jvmci-21.1-b05", "platformspecific": true },
+    "labsjdk-ee-16Debug": {"name": "labsjdk",   "version": "ee-16.0.1+9-jvmci-21.1-b05-debug", "platformspecific": true }
   },
 
   "COMMENT" : "The devkits versions reflect those used to build the JVMCI JDKs (e.g., see devkit_platform_revisions in <jdk>/make/conf/jib-profiles.js)",

common.jsonnet

@@ -52,11 +52,9 @@ local common_json = (import "common.json");
   linux: common + {
     packages+: common_json.sulong.deps.linux.packages + {
       'apache/ab': '==2.3',
-      binutils: '==2.23.2',
-      gcc: '==8.3.0',
+      devtoolset: '==7', # GCC 7.3.1, make 4.2.1, binutils 2.28, valgrind 3.13.0
       git: '>=1.8.3',
       maven: '==3.3.9',
-      valgrind: '>=3.9.0',
     },
     capabilities+: ['linux', 'amd64'],
   },
@@ -72,7 +70,7 @@ local common_json = (import "common.json");
   linux_aarch64: common + {
     capabilities+: ['linux', 'aarch64'],
     packages+: {
-      gcc: '==8.3.0',
+      devtoolset: '==7', # GCC 7.3.1, make 4.2.1, binutils 2.28, valgrind 3.13.0
     }
   },
 
@@ -82,7 +80,7 @@ local common_json = (import "common.json");
       // for compatibility with macOS El Capitan
       MACOSX_DEPLOYMENT_TARGET: '10.11',
     },
-    capabilities: ['darwin', 'amd64'],
+    capabilities: ['darwin_mojave', 'amd64'],
   },
 
   windows: common + {

docs/user/FAQ.md

@@ -20,6 +20,9 @@ Still, several sources of differences have to be considered:
 - **Setup:**
 GraalVM mostly mimicks the original setup of Node, including the `node` executable, `npm`, and similar. However, not all command-line options are supported (or behave exactly identically). You need to (re-)compile native modules against the v8.h file, etc.
 
+Since GraalVM 21.1, Node.js and all related executables (e.g., `node`, `npm`, etc.) are not included by default in the GraalVM binary.
+Node.js support is now packaged in a separate component that can be installed with the _GraalVM Updater_ using `$GRAALVM/bin/gu install nodejs`.
+
 - **Internals:**
 GraalVM is implemented on top of a JVM, and thus has a different internal architecture than Node.js based on V8. This implies that some internal mechanisms behave differently and cannot exactly replicate V8 behaviour. This will hardly ever affect user code, but might affect modules implemented natively, depending on V8 internals.
 
@@ -233,3 +236,35 @@ HostAccess ha = HostAccess.newBuilder(HostAccess.EXPLICIT)
   .allowAccess(Function.class.getMethod("apply", Object.class))
   .build();
 ```
+
+### Warning: Implementation does not support runtime compilation.
+
+If you get the following warning, you are not running on GraalVM or a JVMCI-enabled JVM using the GraalVM compiler:
+```
+[engine] WARNING: The polyglot context is using an implementation that does not support runtime compilation.
+The guest application code will therefore be executed in interpreted mode only.
+Execution only in interpreted mode will strongly impact the guest application performance.
+For more information on using GraalVM see https://www.graalvm.org/java/quickstart/.
+To disable this warning the '--engine.WarnInterpreterOnly=false' option or use the '-Dpolyglot.engine.WarnInterpreterOnly=false' system property.
+```
+
+To resolve this, use [GraalVM](https://www.graalvm.org/java/quickstart/) or see [RunOnJDK.md](https://github.com/oracle/graaljs/blob/master/docs/user/RunOnJDK.md) for instructions how to set up the Graal compiler on a compatible JVMCI-enabled stock JDK.
+
+Nevertheless, if this is intentional, you can disable the warning and continue to run with degraded performance by setting the above mentioned option, either via the command line or using the `Context.Builder`, e.g.:
+```java
+try (Context ctx = Context.newBuilder("js")
+    .option("engine.WarnInterpreterOnly", "false")
+    .build()) {
+  ctx.eval("js", "console.log('Greetings!');");
+}
+```
+Note that when using an explicit polyglot engine, the option has to be set on the `Engine`, e.g.:
+```java
+try (Engine engine = Engine.newBuilder()
+    .option("engine.WarnInterpreterOnly", "false")
+    .build()) {
+  try (Context ctx = Context.newBuilder("js").engine(engine).build()) {
+    ctx.eval("js", "console.log('Greetings!');");
+  }
+}
+```

docs/user/NodeJS.md

@@ -5,6 +5,41 @@ Applications can freely import and use NPM packages, including native ones.
 
 For the differences between running the `node` native launcher and accessing Node.js/npm modules/ECMAScript modules from a Java Context, see [NodeJSVSJavaScriptContext](NodeJSVSJavaScriptContext.md).
 
+## Installing the Node.js component
+
+Since GraalVM 21.1, the Node.js support is packaged in a separate GraalVM component.
+It can be installed with the _GraalVM Updater_.
+
+```shell
+$ $GRAALVM/bin/gu install nodejs
+```
+
+This installs the `node` and `npm` binaries in the `$GRAALVM/bin` directory.
+
+### Polyglot support in Node.js
+
+The Node.js component is able to use the polyglot language interoperability (flag: `--polyglot`) with other installed polyglot languages.
+This feature is available by default in JVM mode (flag: `--jvm`).
+For polyglot access to the Ruby language, you can e.g. use this command:
+
+```shell
+$ $GRAALVM/bin/node --jvm --polyglot -e 'var array = Polyglot.eval("ruby", "[1,2,42,4]"); console.log(array[2]);'
+```
+
+To use the polyglot capabilities of `node` in the native mode (flag: `--native`), the `libpolyglot` needs to be rebuilt first.
+For this, the `native-image` component and the other languages need to be installed first, before the image can be rebuilt:
+
+```shell
+$ $GRAALVM/bin/gu install native-image
+$ $GRAALVM/bin/gu rebuild-images libpolyglot
+```
+
+After a successfull rebuild, the polyglot access is also available in the `--native` mode:
+
+```shell
+$ $GRAALVM/bin/node --native --polyglot -e 'var array = Polyglot.eval("ruby", "[1,2,42,4]"); console.log(array[2]);'
+```
+
 ## Running Node.js Applications
 
 To run Node.js-based applications, use the `node` launcher in the GraalVM distribution:

docs/user/README.md

@@ -7,32 +7,39 @@ To migrate the code previously targeted to the Nashorn or Rhino engines, migrati
 
 ## Running JavaScript
 
-GraalVM can run plain JavaScript code:
+GraalVM can run plain JavaScript (ECMAScript) code:
 ```shell
 js [options] [filename...] -- [args]
 ```
 
 For information about the compatibility of GraalVM JavaScript with existing standards and engines, see [JavaScriptCompatibility](JavaScriptCompatibility.md).
 
 ## Running Node.js
-GraalVM is adapted to run unmodified Node.js applications. Applications can
-import npm modules, including native ones.
+GraalVM is capable of executing unmodified Node.js applications.
+Applications can import npm modules, including native ones.
+Since GraalVM 21.1, the Node.js support is packaged in a separate GraalVM component.
+It can be installed with the _GraalVM Updater_.
 
-To run Node.js-based applications, use the `node` utility bundled with GraalVM by default:
+```shell
+$ $GRAALVM/bin/gu install nodejs
+```
+
+This installs the `node` and `npm` binaries in the `$GRAALVM/bin` directory.
+Use the `node` utility to execute Node.js applications:
 ```shell
 node [options] [filename] [args]
 ```
 
-To install a Node.js module, use the `npm` launcher from the GraalVM's `/bin` folder. The `npm` command is equivalent to the default Node.js command and supports all Node.js APIs.
+To install a Node.js package, use the `npm` launcher from the GraalVM's `/bin` folder.
+The `npm` command is equivalent to the default Node.js command and supports all Node.js APIs.
 
-1. Install the `colors` and `ansispan` modules using `npm install` as
-follows:
+1. Install the `colors` and `ansispan` packages using `npm install` as follows:
 ```shell
 npm install colors ansispan
 ```
-After the modules are installed, you can use them from your application.
+After the packages are installed, you can use them from your application.
 
-2. Add the following code snippet to a file named `app.js` and save it in the same directory where you installed the Node.js modules:
+2. Add the following code snippet to a file named `app.js` and save it in the same directory where you installed the Node.js packages:
 ```js
 const http = require("http");
 const span = require("ansispan");
@@ -52,7 +59,7 @@ node app.js
 ```
 For more information about running Node.js, continue to [Node.js Runtime](NodeJS.md).
 Node.js functionality is available when an application is started from the `node` binary launcher.
-Certain limits apply when launching a Node.js application or accessing npm modules from a Java context, see [Node.js vs. Java Script Context](NodeJSVSJavaScriptContext.md).
+Certain limits apply when launching a Node.js application or accessing npm packages from a Java context, see [Node.js vs. Java Script Context](NodeJSVSJavaScriptContext.md).
 
 ## Interoperability
 

graal-js/mx.graal-js/mx_graal_js.py

@@ -127,8 +127,10 @@ def parse_js_args(args, default_cp=None, useDoubleDash=False):
         if skip:
             skip = False
             continue
-        elif any(arg.startswith(prefix) for prefix in ['-X', '-G:', '-D', '-verbose', '-ea', '-javaagent']) or arg in ['-esa', '-d64', '-server']:
+        elif any(arg.startswith(prefix) for prefix in ['-X', '-D', '-verbose', '-ea', '-javaagent:', '-agentlib:', '-agentpath:']) or arg in ['-esa', '-d64', '-server']:
             vm_args += [arg]
+        elif arg.startswith('--vm.D') or arg.startswith('--vm.X'):
+            vm_args += ['-' + arg[5:]]
         elif useDoubleDash and arg == '--':
             remainder += args[i:]
             break
@@ -158,6 +160,10 @@ def _append_default_js_vm_args(vm_args, min_heap='2g', max_heap='2g', stack_size
             vm_args += ['-Xmx' + max_heap]
     if stack_size and not any(x.startswith('-Xss') for x in vm_args):
         vm_args += ['-Xss' + stack_size]
+
+    if mx.suite('compiler', fatalIfMissing=False) is None and not any(x.startswith('-Dpolyglot.engine.WarnInterpreterOnly') for x in vm_args + get_jdk().java_args):
+        vm_args += ['-Dpolyglot.engine.WarnInterpreterOnly=false']
+
     return vm_args
 
 def _js_cmd_line(args, main_class, default_cp=None, append_default_args=True):
@@ -324,7 +330,8 @@ def is_included(path):
         )
     ],
     boot_jars=['graal-js:GRAALJS_SCRIPTENGINE'],
-    supported=True,
+    installable=True,
+    stability="supported",
 ))
 
 def verify_ci(args):

graal-js/mx.graal-js/native-image.properties

@@ -7,7 +7,7 @@ JavaArgs = -Xmx3G \
            -Dpolyglot.image-build-time.PreinitializeContexts=js
 
 Args = -H:MaxRuntimeCompileMethods=9200 \
-       --initialize-at-build-time=com.oracle.truffle.js,com.oracle.js.parser,com.oracle.truffle.trufflenode,com.oracle.truffle.regex \
+       --initialize-at-build-time=com.oracle.truffle.js,com.oracle.js.parser,com.oracle.truffle.regex \
        --initialize-at-run-time=com.ibm.icu \
        -H:ReflectionConfigurationResources=com/oracle/truffle/js/runtime/resources/reflect-config.json \
        -H:ResourceConfigurationResources=com/oracle/truffle/js/runtime/resources/resource-config.json