mlton-commit Mailing List for MLton

  Branch: refs/heads/master
  Home:   https://github.com/MLton/mlton
  Commit: 3d3109d9fe4df91121e3acc85c83c1baa4a66376
      https://github.com/MLton/mlton/commit/3d3109d9fe4df91121e3acc85c83c1baa4a66376
  Author: Vedant Raiththa <ved...@gm...>
  Date:   2014-11-11 (Tue, 11 Nov 2014)

  Changed paths:
    R mlton/ast/admits-equality.fun
    R mlton/ast/admits-equality.sig
    R mlton/ast/char-size.fun
    R mlton/ast/char-size.sig
    R mlton/ast/field.fun
    R mlton/ast/field.sig
    R mlton/ast/int-size.fun
    R mlton/ast/int-size.sig
    R mlton/ast/prim-cons.fun
    R mlton/ast/prim-cons.sig
    R mlton/ast/prim-tycons.fun
    R mlton/ast/prim-tycons.sig
    R mlton/ast/real-size.fun
    R mlton/ast/real-size.sig
    R mlton/ast/record.fun
    R mlton/ast/record.sig
    M mlton/ast/sources.mlb
    R mlton/ast/symbol.fun
    R mlton/ast/symbol.sig
    R mlton/ast/tycon-kind.fun
    R mlton/ast/tycon-kind.sig
    R mlton/ast/tyvar.fun
    R mlton/ast/tyvar.sig
    R mlton/ast/word-size.fun
    R mlton/ast/word-size.sig
    R mlton/ast/wrapped.sig
    A mlton/atoms/admits-equality.fun
    A mlton/atoms/admits-equality.sig
    A mlton/atoms/char-size.fun
    A mlton/atoms/char-size.sig
    A mlton/atoms/field.fun
    A mlton/atoms/field.sig
    A mlton/atoms/int-size.fun
    A mlton/atoms/int-size.sig
    A mlton/atoms/prim-cons.fun
    A mlton/atoms/prim-cons.sig
    A mlton/atoms/prim-tycons.fun
    A mlton/atoms/prim-tycons.sig
    A mlton/atoms/real-size.fun
    A mlton/atoms/real-size.sig
    A mlton/atoms/record.fun
    A mlton/atoms/record.sig
    M mlton/atoms/sources.mlb
    A mlton/atoms/symbol.fun
    A mlton/atoms/symbol.sig
    A mlton/atoms/tycon-kind.fun
    A mlton/atoms/tycon-kind.sig
    A mlton/atoms/tyvar.fun
    A mlton/atoms/tyvar.sig
    A mlton/atoms/word-size.fun
    A mlton/atoms/word-size.sig
    A mlton/atoms/wrapped.sig

  Log Message:
  -----------
  Moved files from ast to atoms and changed references in the sources.mlb file.


  Commit: 4a0c8496645b07a30b34254953ce09516f937f67
      https://github.com/MLton/mlton/commit/4a0c8496645b07a30b34254953ce09516f937f67
  Author: Vedant Raiththa <ved...@gm...>
  Date:   2014-11-14 (Fri, 14 Nov 2014)

  Changed paths:
    M mlton/ast/ast-atoms.fun
    M mlton/ast/ast-atoms.sig
    M mlton/atoms/atoms.fun
    M mlton/atoms/atoms.sig
    M mlton/atoms/sources.mlb
    M mlton/main/compile.fun

  Log Message:
  -----------
  References refactored


  Commit: beb16c149061cbb8b4e885902f459bef48f12395
      https://github.com/MLton/mlton/commit/beb16c149061cbb8b4e885902f459bef48f12395
  Author: Vedant Raiththa <ved...@gm...>
  Date:   2014-11-14 (Fri, 14 Nov 2014)

  Changed paths:
    M mlton/ast/sources.cm
    M mlton/atoms/sources.cm
    M mlton/atoms/sources.mlb

  Log Message:
  -----------
  smlnj compilation files updated accordingly


  Commit: 48b9b238437fc7791cc846f85921601e9f7a79b7
      https://github.com/MLton/mlton/commit/48b9b238437fc7791cc846f85921601e9f7a79b7
  Author: Matthew Fluet <mat...@gm...>
  Date:   2014-12-17 (Wed, 17 Dec 2014)

  Changed paths:
    M mlton/backend/sources.cm
    M mlton/backend/sources.mlb
    M mlton/codegen/amd64-codegen/sources.cm
    M mlton/codegen/amd64-codegen/sources.mlb
    M mlton/codegen/c-codegen/sources.cm
    M mlton/codegen/c-codegen/sources.mlb
    M mlton/codegen/llvm-codegen/sources.cm
    M mlton/codegen/llvm-codegen/sources.mlb
    M mlton/codegen/x86-codegen/sources.cm
    M mlton/codegen/x86-codegen/sources.mlb
    M mlton/core-ml/sources.cm
    M mlton/core-ml/sources.mlb
    M mlton/elaborate/sources.cm
    M mlton/match-compile/sources.cm
    M mlton/ssa/sources.cm
    M mlton/xml/sources.cm

  Log Message:
  -----------
  Cleanup `sources.mlb` and `sources.cm` files.

In particular, drop references to `../ast/sources.mlb` and
`../ast/sources.cm`, since the necessary structures are now provided
by `../atoms/sources.mlb` and `../atoms/sources.cm`.


  Commit: 9a85e8d5e8679ab111b7e90f7f56db3202e32996
      https://github.com/MLton/mlton/commit/9a85e8d5e8679ab111b7e90f7f56db3202e32996
  Author: Matthew Fluet <mat...@gm...>
  Date:   2014-12-17 (Wed, 17 Dec 2014)

  Changed paths:
    M doc/guide/src/AST.adoc
    M mlton/atoms/sources.cm
    M mlton/atoms/sources.mlb
    R mlton/atoms/wrapped.sig
    M mlton/control/sources.cm
    M mlton/control/sources.mlb
    A mlton/control/wrapped.sig

  Log Message:
  -----------
  Move `signature WRAPPED` to `control` directory.


  Commit: 9cb35cbe8fcb8ac3ee0df60d521a6e17dd48bf91
      https://github.com/MLton/mlton/commit/9cb35cbe8fcb8ac3ee0df60d521a6e17dd48bf91
  Author: Matthew Fluet <mat...@gm...>
  Date:   2014-12-22 (Mon, 22 Dec 2014)

  Changed paths:
    M mlton/atoms/atoms.fun
    M mlton/atoms/atoms.sig
    M mlton/match-compile/match-compile.fun

  Log Message:
  -----------
  Drop unused `structure Atoms.Vars : SET`.


  Commit: 3b324bf30d191a2092ce3929f21ed3e691a35ca5
      https://github.com/MLton/mlton/commit/3b324bf30d191a2092ce3929f21ed3e691a35ca5
  Author: Matthew Fluet <mat...@gm...>
  Date:   2014-12-22 (Mon, 22 Dec 2014)

  Changed paths:
    M mlton/atoms/atoms.fun
    M mlton/atoms/atoms.sig
    M mlton/atoms/tycon.fun
    M mlton/atoms/tycon.sig

  Log Message:
  -----------
  Complete `sharing` constraints for `signature ATOMS`.


  Commit: 039edb8e2740263051eacc5e6430fd7fd3141721
      https://github.com/MLton/mlton/commit/039edb8e2740263051eacc5e6430fd7fd3141721
  Author: Matthew Fluet <mat...@gm...>
  Date:   2014-12-22 (Mon, 22 Dec 2014)

  Changed paths:
    M mlton/atoms/sources.cm
    M mlton/atoms/sources.mlb

  Log Message:
  -----------
  Reorganize `atoms/sources.{cm,mlb}`.


  Commit: f1859035a43b4363dfce83a6120c0a1bf160c4c0
      https://github.com/MLton/mlton/commit/f1859035a43b4363dfce83a6120c0a1bf160c4c0
  Author: Matthew Fluet <Mat...@gm...>
  Date:   2014-12-22 (Mon, 22 Dec 2014)

  Changed paths:
    M doc/guide/src/AST.adoc
    R mlton/ast/admits-equality.fun
    R mlton/ast/admits-equality.sig
    M mlton/ast/ast-atoms.fun
    M mlton/ast/ast-atoms.sig
    R mlton/ast/char-size.fun
    R mlton/ast/char-size.sig
    R mlton/ast/field.fun
    R mlton/ast/field.sig
    R mlton/ast/int-size.fun
    R mlton/ast/int-size.sig
    R mlton/ast/prim-cons.fun
    R mlton/ast/prim-cons.sig
    R mlton/ast/prim-tycons.fun
    R mlton/ast/prim-tycons.sig
    R mlton/ast/real-size.fun
    R mlton/ast/real-size.sig
    R mlton/ast/record.fun
    R mlton/ast/record.sig
    M mlton/ast/sources.cm
    M mlton/ast/sources.mlb
    R mlton/ast/symbol.fun
    R mlton/ast/symbol.sig
    R mlton/ast/tycon-kind.fun
    R mlton/ast/tycon-kind.sig
    R mlton/ast/tyvar.fun
    R mlton/ast/tyvar.sig
    R mlton/ast/word-size.fun
    R mlton/ast/word-size.sig
    R mlton/ast/wrapped.sig
    A mlton/atoms/admits-equality.fun
    A mlton/atoms/admits-equality.sig
    M mlton/atoms/atoms.fun
    M mlton/atoms/atoms.sig
    A mlton/atoms/char-size.fun
    A mlton/atoms/char-size.sig
    A mlton/atoms/field.fun
    A mlton/atoms/field.sig
    A mlton/atoms/int-size.fun
    A mlton/atoms/int-size.sig
    A mlton/atoms/prim-cons.fun
    A mlton/atoms/prim-cons.sig
    A mlton/atoms/prim-tycons.fun
    A mlton/atoms/prim-tycons.sig
    A mlton/atoms/real-size.fun
    A mlton/atoms/real-size.sig
    A mlton/atoms/record.fun
    A mlton/atoms/record.sig
    M mlton/atoms/sources.cm
    M mlton/atoms/sources.mlb
    A mlton/atoms/symbol.fun
    A mlton/atoms/symbol.sig
    A mlton/atoms/tycon-kind.fun
    A mlton/atoms/tycon-kind.sig
    M mlton/atoms/tycon.fun
    M mlton/atoms/tycon.sig
    A mlton/atoms/tyvar.fun
    A mlton/atoms/tyvar.sig
    A mlton/atoms/word-size.fun
    A mlton/atoms/word-size.sig
    M mlton/backend/sources.cm
    M mlton/backend/sources.mlb
    M mlton/codegen/amd64-codegen/sources.cm
    M mlton/codegen/amd64-codegen/sources.mlb
    M mlton/codegen/c-codegen/sources.cm
    M mlton/codegen/c-codegen/sources.mlb
    M mlton/codegen/llvm-codegen/sources.cm
    M mlton/codegen/llvm-codegen/sources.mlb
    M mlton/codegen/x86-codegen/sources.cm
    M mlton/codegen/x86-codegen/sources.mlb
    M mlton/control/sources.cm
    M mlton/control/sources.mlb
    A mlton/control/wrapped.sig
    M mlton/core-ml/sources.cm
    M mlton/core-ml/sources.mlb
    M mlton/elaborate/sources.cm
    M mlton/main/compile.fun
    M mlton/match-compile/match-compile.fun
    M mlton/match-compile/sources.cm
    M mlton/ssa/sources.cm
    M mlton/xml/sources.cm

  Log Message:
  -----------
  Merge pull request #92 from MatthewFluet/RestructuringAtoms

Move pervasive constructs from `ast` to `atoms`.

Most program constructs (e.g., `WordX` for word constants, `Label` for basic block labels) that are used in multiple ILs are defined in the `atoms` directory. However, some program constructs (e.g., `WordSize` for word constants, `Field` for record fields) that are used in multiple ILs are defined in the `ast` directory.

This commit moves all of the pervasive program constructs that are defined in `ast` to `atoms`, so that `ast/sources.mlb` depends on `atoms/sources.mlb` and not the other way around.


Compare: https://github.com/MLton/mlton/compare/75dc70e6bc4d...f1859035a43b

  Branch: refs/heads/master
  Home:   https://github.com/MLton/mlton
  Commit: 97c2bdf1db0977cb9b3439fc74ea72207c6670a0
      https://github.com/MLton/mlton/commit/97c2bdf1db0977cb9b3439fc74ea72207c6670a0
  Author: Matthew Fluet <mat...@gm...>
  Date:   2014-12-06 (Sat, 06 Dec 2014)

  Changed paths:
    M basis-library/mlton/thread.sml

  Log Message:
  -----------
  Cache a worker thread to service calls to `_export`-ed functions.

Each call from C to an `_export`-ed SML function resulted in the
creation of a new ML thread to service the call.  An application that
made many calls to `_export`-ed SML functions could result in a
significant cost in terms of allocation and garbage collection; see
http://sourceforge.net/p/mlton/mailman/message/33116352/.

Recall the implementation of `_export`-ed SML functions.  Each source
program `_export` is assigned a unique integer and the `_export`
expression becomes a function that stores (a wrapped version of) the
SML function into a global array at the appropriate index.  An ML
thread is created and registered in the runtime to handle (not
service) all calls of `_export`-ed SML functions.  This ML thread is a
simple loop that inspects global state to determine the index of the
`_export`-ed SML function that is being called, extracts (the wrapped
version of) the SML function from the global array, creates a new ML
thread to execute the extracted SML function (and service the call of
the `_export`-ed SML function), and switches to the new ML thread,
leaving the handler ML thread paused ready to go around the loop and
handle the next call of an `_export`-ed SML function.  It is not
possible for the handler ML thread to call the extracted SML function
(and service the call), because the extracted function might call an
`_import`-ed C function which in turns calls an `_export`-ed SML
function; when trying to handle this nested call of an `_export`-ed
SML function, the handler ML thread would be paused at the call of the
`_import`-ed C function, not paused in the handler loop, and chaos
would ensue.  Thus, a separate ML thread is required to service the
call of the `_export`-ed SML function, leaving the handler ML thread
ready to handle nested and subsequent calls of `_export`-ed SML
functions.

However, mutual recursion between SML and C is probably not common.
The common case is probably that of SML calling C calling SML (or, in
the case of a SML system-level library, just C calling SML).  In this
common case, it shouldn't be necessary to create a new ML thread per
call of an `_export`-ed SML function.

In this common case, it would be possible for the handler ML thread to
also service the call of the `_export`-ed function.  However, we still
need to handle the situation where there is deeper recursion between
SML and C.  Creating and registering a new handler ML thread while the
original handler ML thread is servicing the call of the `_export`-ed
function isn't a solution to the allocation problem, since a new
handler ML thread is created per call of an `_export`-ed SML function.
Lazily creating a new handler ML thread isn't a solution either, since
we can't recover from the original handler ML thread paused at the
call of the `_import`-ed C function (and not paused in the handler
loop).

A better solution is to create a worker ML thread to service the call
of an `_export`-ed SML function and reuse this worker thread when it
is not already servicing the call of an `_export`-ed SML function.
Essentially, a `val worker: Prim.thread option ref` is created to
cache an available worker ML thread.  The handler ML thread inspects
`worker` for an available worker thread: if `!worker` is `NONE`, then
a new worker ML thread is created; if `!worker` is `SOME wrk_thrd`,
then `worker` is updated to `NONE` (indicating that no worker thread
is available; the `wrk_thrd` worker thread is now servicing the call
of the `_export`-ed SML function).  When a worker ML thread is about
to return to C (and pause ready to go around the loop and service the
next call of an `_export`-ed SML function), it updates `worker` to
`SOME self`, making itself available.

In the common case, a single worker ML thread is created at the first
call of an `_export`-ed SML function, and this worker ML thread is
reused for all subsequent calls of `_export`-ed SML functions.  The
example program from the above message results in no additional
allocation per call of the `_export`-ed SML function (resulting in
significantly faster overall execution).

While it would be possible to replace `val worker: Prim.thread option
ref` with `val workers: Prim.thread list ref`, allowing multiple
worker ML threads to persist after some mutual recursion between SML
and C, this would result in a small amount of additional alloction per
call of `_export`-ed SML function corresponding cons-cell allocation
in the the update of `workers` to `self :: !workers`.


  Commit: 75dc70e6bc4d661bed6eeb8c3cc063e061c087d6
      https://github.com/MLton/mlton/commit/75dc70e6bc4d661bed6eeb8c3cc063e061c087d6
  Author: Matthew Fluet <Mat...@gm...>
  Date:   2014-12-17 (Wed, 17 Dec 2014)

  Changed paths:
    M basis-library/mlton/thread.sml

  Log Message:
  -----------
  Merge pull request #91 from MatthewFluet/export-allocation

Cache a worker thread to service calls to `_export`-ed functions.


Compare: https://github.com/MLton/mlton/compare/7041382a9dbd...75dc70e6bc4d

  Branch: refs/heads/master
  Home:   https://github.com/MLton/mlton
  Commit: 4055a88ebb9182fa223877b23c9aac63439f77d5
      https://github.com/MLton/mlton/commit/4055a88ebb9182fa223877b23c9aac63439f77d5
  Author: Matthew Fluet <mat...@gm...>
  Date:   2014-12-02 (Tue, 02 Dec 2014)

  Changed paths:
    M mlton/front-end/Makefile

  Log Message:
  -----------
  Post-process generated front-end files.

SML/NJ's recent ml-lex and ml-yacc tools generate long identifiers
rather than unqualified (top-level environment) identifiers; that is,
they generate "List.map"/"List.rev" rather than "map"/"rev" and
"General.Subscript" rather than "Subscript".  Unfortunately, in the
context of building mlton-compile, the generated front-end files are
elaborated in the environment provided by the MLton utility library,
not the environment provided by the SML Basis Library.  While the
MLton utility library does re-export the top-level environment of the
SML Basis Library, MLton's utility library provides a structure List
that is incompatible with the SML Basis Library's structure List
(MLton's utility library provides an uncurried List.map, while the SML
Basis Library provides a curried List.map) and the MLton utility
library does not provide a structure General.  Furthermore, with
SML/NJ's recent ml-lex and ml-yacc tools, both the SML Basis Library's
structure List and the MLton utility library's structure List are used
in the generated code --- the former by the tool generated code and
the later by the semantic actions.

(SML/NJ's recent ml-lex and ml-yacc tools also generate
"String.substring"/"String.size" rather than "substring"/"size", but
MLton's utility library provides a structure String that is compatible
with the SML Basis Library's structure String for these functions.)

To accomodate SML/NJ's recent ml-lex and ml-yacc tools, post-process
the generated front-end files, replacing the generated occurrences of
"List." and "General." with "Pervasive.List." and
"Pervasive.General.".

Fixes MLton/mlton#77 and fixes MLton/mlton#86.


  Commit: 7041382a9dbda322068299fc813aff5702134d22
      https://github.com/MLton/mlton/commit/7041382a9dbda322068299fc813aff5702134d22
  Author: Matthew Fluet <Mat...@gm...>
  Date:   2014-12-02 (Tue, 02 Dec 2014)

  Changed paths:
    M mlton/front-end/Makefile

  Log Message:
  -----------
  Merge pull request #87 from MatthewFluet/smlnj-tools-for-front-end

Post-process generated front-end files.


Compare: https://github.com/MLton/mlton/compare/64369b40f9fb...7041382a9dbd

  Branch: refs/heads/master
  Home:   https://github.com/MLton/mlton
  Commit: 183e9af7eb05a491da4063369ab0d9627bb070f6
      https://github.com/MLton/mlton/commit/183e9af7eb05a491da4063369ab0d9627bb070f6
  Author: Daniel Rosenwasser <Dan...@gm...>
  Date:   2014-11-30 (Sun, 30 Nov 2014)

  Changed paths:
    M doc/guide/src/SelfCompiling.adoc

  Log Message:
  -----------
  Corrected documentation for SML/NJ Makefile target


  Commit: c8e9c73692fec8636bf3334bd2214e77d9e04626
      https://github.com/MLton/mlton/commit/c8e9c73692fec8636bf3334bd2214e77d9e04626
  Author: Daniel Rosenwasser <Dan...@gm...>
  Date:   2014-11-30 (Sun, 30 Nov 2014)

  Changed paths:
    M Makefile

  Log Message:
  -----------
  Fixed bootstrap-nj target


  Commit: 64369b40f9fb9c09b717d27d8fdacb82a52b55cd
      https://github.com/MLton/mlton/commit/64369b40f9fb9c09b717d27d8fdacb82a52b55cd
  Author: Matthew Fluet <Mat...@gm...>
  Date:   2014-12-02 (Tue, 02 Dec 2014)

  Changed paths:
    M Makefile
    M doc/guide/src/SelfCompiling.adoc

  Log Message:
  -----------
  Merge pull request #85 from DanielRosenwasser/compile-smlnj-doc

Corrected documentation for SML/NJ Makefile target & fixed bootstrap-nj target.


Compare: https://github.com/MLton/mlton/compare/4f7f652962ed...64369b40f9fb