InternalException HandshakeFailed happens during nightly builds

[psibi]

Note that I was not able to reproduce this locally on my Linux machine. The 4095-utf8-pure-nix test has been failing in Azure CI frequently with this log:

2019-01-31T08:42:17.6278740Z        Selected mirror https://s3.amazonaws.com/hackage.fpcomplete.com/
2019-01-31T08:42:17.6278820Z        Downloading root
2019-01-31T08:42:17.6278890Z        SomeRemoteError (HttpExceptionRequest Request {
2019-01-31T08:42:17.6278980Z          host                 = "s3.amazonaws.com"
2019-01-31T08:42:17.6279050Z          port                 = 443
2019-01-31T08:42:17.6279130Z          secure               = True
2019-01-31T08:42:17.6279770Z          requestHeaders       = [("Accept-Encoding",""),("Cache-Control","no-transform"),("User-Agent","Haskell pantry package")]
2019-01-31T08:42:17.6280010Z          path                 = "/hackage.fpcomplete.com/root.json"
2019-01-31T08:42:17.6280120Z          queryString          = ""
2019-01-31T08:42:17.6280190Z          method               = "GET"
2019-01-31T08:42:17.6280280Z          proxy                = Nothing
2019-01-31T08:42:17.6280350Z          rawBody              = False
2019-01-31T08:42:17.6280630Z          redirectCount        = 10
2019-01-31T08:42:17.6280710Z          responseTimeout      = ResponseTimeoutDefault
2019-01-31T08:42:17.6280790Z          requestVersion       = HTTP/1.1
2019-01-31T08:42:17.6280870Z        }
2019-01-31T08:42:17.6280980Z         (InternalException (HandshakeFailed (Error_Protocol ("certificate rejected: security: createProcess: runInteractiveProcess: exec: does not exist (No such file or directory)",True,CertificateUnknown)))))
2019-01-31T08:42:17.6281120Z        Main.hs: Exited with exit code: ExitFailure 1
2019-01-31T08:42:17.6281190Z        CallStack (from HasCallStack):
2019-01-31T08:42:17.6281290Z          error, called at /Users/vsts/agent/2.144.2/work/1/s/test/integration/lib/StackTest.hs:52:34 in main:StackTest
2019-01-31T08:42:17.6281950Z          stack, called at /Users/vsts/agent/2.144.2/work/1/s/test/integration/tests/4095-utf8-pure-nix/Main.hs:8:8 in main:Main
2019-01-31T08:42:17.6282100Z        )

Build log link: https://dev.azure.com/commercialhaskell/stack/_build/results?buildId=441 (Failing for Mac OS specifically)

Used Stack version: Reproducible with the latest commit in master ( commit 59efd85 ). But you may want to check Azure nightly too.

[nh2]

The error message looks very suspicious:

• It mentions a certificate rejected error
• But at the same time, it claims No such file or directory -- but which file is it trying to execute that doesn't exist?

[dbaynard]

Try the fix in #907?

[snoyberg]

@psibi It looks like this is no longer occurring in the most recent Azure builds.

[psibi]

Yeah, has not been occurring recently. Closing the issue as of now.

[avdv]

FTR, I am seeing this error on CI using macos-12 and stack 2.13.1 currently:

Selected mirror https://hackage.haskell.org/
Downloading root
HttpExceptionRequest Request {
  host                 = "hackage.haskell.org"
  port                 = 443
  secure               = True
  requestHeaders       = [("Accept-Encoding",""),("User-Agent","Haskell pantry package")]
  path                 = "/root.json"
  queryString          = ""
  method               = "GET"
  proxy                = Nothing
  rawBody              = False
  redirectCount        = 10
  responseTimeout      = ResponseTimeoutDefault
  requestVersion       = HTTP/1.1
  proxySecureMode      = ProxySecureWithConnect
}
 (InternalException (HandshakeFailed (Error_Protocol "certificate rejected: security: createProcess: posix_spawnp: does not exist (No such file or directory)" CertificateUnknown)))

As the error message indicates, it is indeed trying to run the program security, from here

So the security binary needs to be in $PATH -- I am using a pure nix-shell to run CI actions which makes this fail...