windows networking configuration difference between -dev and non-dev mode

[eusousu]

Nomad version

Nomad v1.10.1
BuildDate 2025-05-13T07:40:43Z
Revision 3431f13

Operating system and Environment details

OS: Windows 11 Pro
Version: 24H2

Issue

Can't start a simple nomad agent as server and client on localhost without dev mode.

Running agent on dev mode works fine but doesn't have persistence as informed in issue #26066, to have persistence I need to run without dev.

Each configuration file provide gets more complex trying to navigate a solution to the provided error, but without success.

On the 4th log I don't understand why it still tries to find a initial configuration at <default-gateway>:4647 instead of 127.0.0.1:4647 like the dev mode do.

Reproduction steps

• run nomad agent -config=<config-path> with the provided configs

Expected Result

Nomad starts

Actual Result

Get an error:

[ERROR] agent: error starting agent: error="client setup failed: fingerprinting failed: Error while detecting network interface  during fingerprinting: No default interface found with matching IP"

Suggestion

Wouldn't it be possible to be able to provide a data_dir to dev mode to enable persistence?

Nomad configuration file 1

data_dir = "C:/opt/nomad/data"
log_file = "C:/opt/nomad/logs/nomad.log"

server {
  enabled          = true
  bootstrap_expect = 1
}

client {
  enabled = true
}

plugin "raw_exec" {
  config {
    enabled = true
  }
}

Nomad Server logs 1

==> WARNING: mTLS is not configured - Nomad is not secure without mTLS!
==> WARNING: Bootstrap mode enabled! Potentially unsafe operation.
==> Loaded configuration from <config-path>
==> Starting Nomad agent...
==> Error starting agent: client setup failed: fingerprinting failed: Error while detecting network interface  during fingerprinting: No default interface found with matching IP
    2025-06-17T11:11:21.843-0300 [INFO]  nomad: setting up raft bolt store: no_freelist_sync=false
    2025-06-17T11:11:21.845-0300 [INFO]  nomad.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:<ID> Address:<default-gateway>:4647}]"
    2025-06-17T11:11:21.846-0300 [INFO]  nomad.raft: entering follower state: follower="Node at <default-gateway>:4647 [Follower]" leader-address= leader-id=
    2025-06-17T11:11:21.847-0300 [INFO]  nomad: serf: EventMemberJoin: <machine-name>.global <default-gateway>
    2025-06-17T11:11:21.847-0300 [INFO]  nomad: starting scheduling worker(s): num_workers=12 schedulers=["service", "batch", "system", "sysbatch", "_core"]
    2025-06-17T11:11:21.847-0300 [WARN]  nomad: serf: Failed to re-join any previously known node
    2025-06-17T11:11:21.847-0300 [INFO]  nomad: started scheduling worker(s): num_workers=12 schedulers=["service", "batch", "system", "sysbatch", "_core"]
    2025-06-17T11:11:21.847-0300 [INFO]  nomad: adding server: server="<machine-name>.global (Addr: <default-gateway>:4647) (DC: dc1)"
    2025-06-17T11:11:21.848-0300 [WARN]  agent.plugin_loader: skipping external plugins since plugin_dir doesn't exist: plugin_dir=C:\opt\nomad\data\plugins
    2025-06-17T11:11:21.848-0300 [INFO]  agent: detected plugin: name=raw_exec type=driver plugin_version=0.1.0
    2025-06-17T11:11:21.849-0300 [INFO]  agent: detected plugin: name=exec type=driver plugin_version=0.1.0
    2025-06-17T11:11:21.849-0300 [INFO]  agent: detected plugin: name=qemu type=driver plugin_version=0.1.0
    2025-06-17T11:11:21.849-0300 [INFO]  agent: detected plugin: name=java type=driver plugin_version=0.1.0
    2025-06-17T11:11:21.849-0300 [INFO]  agent: detected plugin: name=docker type=driver plugin_version=0.1.0
    2025-06-17T11:11:21.849-0300 [INFO]  client: using state directory: state_dir=C:\opt\nomad\data\client
    2025-06-17T11:11:21.849-0300 [INFO]  client: using alloc directory: alloc_dir=C:\opt\nomad\data\alloc
    2025-06-17T11:11:21.849-0300 [INFO]  client: using dynamic ports: min=20000 max=32000 reserved=14000-14512
    2025-06-17T11:11:21.881-0300 [WARN]  client.fingerprint_mgr.consul: failed to acquire consul self endpoint: cluster=default error="Get \"http://127.0.0.1:8500/v1/agent/self\": dial tcp 127.0.0.1:8500: connectex: No connection could be made because the target machine actively refused it."
    2025-06-17T11:11:21.955-0300 [WARN]  client.fingerprint_mgr.landlock: failed to fingerprint kernel landlock feature: error="landlock not supported on this platform"
    2025-06-17T11:11:22.155-0300 [ERROR] agent: error starting agent: error="client setup failed: fingerprinting failed: Error while detecting network interface  during fingerprinting: No default interface found with matching IP"

Nomad configuration file 2

data_dir = "C:/opt/nomad/data"
log_file = "C:/opt/nomad/logs/nomad.log"

bind_addr = "127.0.0.1"

server {
  enabled          = true
  bootstrap_expect = 1
}

client {
  enabled = true
}

plugin "raw_exec" {
  config {
    enabled = true
  }
}

Nomad Server logs 2

==> Failed to parse HTTP advertise address (, 127.0.0.1, 4646, false): Defaulting advertise to localhost is unsafe, please set advertise manually

Nomad configuration file 3

data_dir = "C:/opt/nomad/data"
log_file = "C:/opt/nomad/logs/nomad.log"

bind_addr = "127.0.0.1"

advertise {
  http = "127.0.0.1"
  serf = "127.0.0.1"
  rpc  = "127.0.0.1"
}

server {
  enabled          = true
  bootstrap_expect = 1
}

client {
  enabled = true
}

plugin "raw_exec" {
  config {
    enabled = true
  }
}

Nomad Server logs 3

==> WARNING: mTLS is not configured - Nomad is not secure without mTLS!
==> WARNING: Bootstrap mode enabled! Potentially unsafe operation.
==> Loaded configuration from <config-path>
==> Starting Nomad agent...
==> Error starting agent: client setup failed: fingerprinting failed: Error while detecting network interface  during fingerprinting: No default interface found with matching IP
    2025-06-17T11:21:40.949-0300 [INFO]  nomad: setting up raft bolt store: no_freelist_sync=false
    2025-06-17T11:21:40.951-0300 [INFO]  nomad.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:<ID> Address:<default-gateway>:4647}]"
    2025-06-17T11:21:40.951-0300 [INFO]  nomad.raft: entering follower state: follower="Node at 127.0.0.1:4647 [Follower]" leader-address= leader-id=
    2025-06-17T11:21:40.952-0300 [INFO]  nomad: serf: EventMemberJoin: <machine-name>.global 127.0.0.1
    2025-06-17T11:21:40.953-0300 [INFO]  nomad: starting scheduling worker(s): num_workers=12 schedulers=["service", "batch", "system", "sysbatch", "_core"]
    2025-06-17T11:21:40.953-0300 [WARN]  nomad: serf: Failed to re-join any previously known node
    2025-06-17T11:21:40.953-0300 [INFO]  nomad: started scheduling worker(s): num_workers=12 schedulers=["service", "batch", "system", "sysbatch", "_core"]
    2025-06-17T11:21:40.953-0300 [INFO]  nomad: adding server: server="<machine-name>.global (Addr: 127.0.0.1:4647) (DC: dc1)"
    2025-06-17T11:21:40.954-0300 [WARN]  agent.plugin_loader: skipping external plugins since plugin_dir doesn't exist: plugin_dir=C:\opt\nomad\data\plugins
    2025-06-17T11:21:40.956-0300 [INFO]  agent: detected plugin: name=raw_exec type=driver plugin_version=0.1.0
    2025-06-17T11:21:40.956-0300 [INFO]  agent: detected plugin: name=exec type=driver plugin_version=0.1.0
    2025-06-17T11:21:40.956-0300 [INFO]  agent: detected plugin: name=qemu type=driver plugin_version=0.1.0
    2025-06-17T11:21:40.956-0300 [INFO]  agent: detected plugin: name=java type=driver plugin_version=0.1.0
    2025-06-17T11:21:40.956-0300 [INFO]  agent: detected plugin: name=docker type=driver plugin_version=0.1.0
    2025-06-17T11:21:40.956-0300 [INFO]  client: using state directory: state_dir=C:\opt\nomad\data\client
    2025-06-17T11:21:40.957-0300 [INFO]  client: using alloc directory: alloc_dir=C:\opt\nomad\data\alloc
    2025-06-17T11:21:40.957-0300 [INFO]  client: using dynamic ports: min=20000 max=32000 reserved=14000-14512
    2025-06-17T11:21:40.989-0300 [WARN]  client.fingerprint_mgr.consul: failed to acquire consul self endpoint: cluster=default error="Get \"http://127.0.0.1:8500/v1/agent/self\": dial tcp 127.0.0.1:8500: connectex: No connection could be made because the target machine actively refused it."
    2025-06-17T11:21:41.056-0300 [WARN]  client.fingerprint_mgr.landlock: failed to fingerprint kernel landlock feature: error="landlock not supported on this platform"
    2025-06-17T11:21:41.285-0300 [ERROR] agent: error starting agent: error="client setup failed: fingerprinting failed: Error while detecting network interface  during fingerprinting: No default interface found with matching IP"

Nomad configuration file 4

data_dir = "C:/opt/nomad/data"
log_file = "C:/opt/nomad/logs/nomad.log"

bind_addr = "127.0.0.1"

advertise {
  http = "127.0.0.1"
  serf = "127.0.0.1"
  rpc  = "127.0.0.1"
}

server {
  enabled          = true
  bootstrap_expect = 1
}

client {
  enabled = true
  servers = ["127.0.0.1:4647"]
}

plugin "raw_exec" {
  config {
    enabled = true
  }
}

Nomad Server logs 4

==> WARNING: mTLS is not configured - Nomad is not secure without mTLS!
==> WARNING: Bootstrap mode enabled! Potentially unsafe operation.
==> Loaded configuration from <config-path>
==> Starting Nomad agent...
==> Error starting agent: client setup failed: fingerprinting failed: Error while detecting network interface  during fingerprinting: No default interface found with matching IP
    2025-06-17T11:24:05.218-0300 [INFO]  nomad: setting up raft bolt store: no_freelist_sync=false
    2025-06-17T11:24:05.221-0300 [INFO]  nomad.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:<ID> Address:<default-gateway>:4647}]"
    2025-06-17T11:24:05.222-0300 [INFO]  nomad.raft: entering follower state: follower="Node at 127.0.0.1:4647 [Follower]" leader-address= leader-id=
    2025-06-17T11:24:05.223-0300 [INFO]  nomad: serf: EventMemberJoin: <machine-name>.global 127.0.0.1
    2025-06-17T11:24:05.223-0300 [INFO]  nomad: starting scheduling worker(s): num_workers=12 schedulers=["sysbatch", "service", "batch", "system", "_core"]
    2025-06-17T11:24:05.223-0300 [WARN]  nomad: serf: Failed to re-join any previously known node
    2025-06-17T11:24:05.223-0300 [INFO]  nomad: started scheduling worker(s): num_workers=12 schedulers=["sysbatch", "service", "batch", "system", "_core"]
    2025-06-17T11:24:05.223-0300 [INFO]  nomad: adding server: server="<machine-name>.global (Addr: 127.0.0.1:4647) (DC: dc1)"
    2025-06-17T11:24:05.223-0300 [WARN]  agent.plugin_loader: skipping external plugins since plugin_dir doesn't exist: plugin_dir=C:\opt\nomad\data\plugins
    2025-06-17T11:24:05.225-0300 [INFO]  agent: detected plugin: name=qemu type=driver plugin_version=0.1.0
    2025-06-17T11:24:05.225-0300 [INFO]  agent: detected plugin: name=java type=driver plugin_version=0.1.0
    2025-06-17T11:24:05.225-0300 [INFO]  agent: detected plugin: name=docker type=driver plugin_version=0.1.0
    2025-06-17T11:24:05.225-0300 [INFO]  agent: detected plugin: name=raw_exec type=driver plugin_version=0.1.0
    2025-06-17T11:24:05.225-0300 [INFO]  agent: detected plugin: name=exec type=driver plugin_version=0.1.0
    2025-06-17T11:24:05.226-0300 [INFO]  client: using state directory: state_dir=C:\opt\nomad\data\client
    2025-06-17T11:24:05.227-0300 [INFO]  client: using alloc directory: alloc_dir=C:\opt\nomad\data\alloc
    2025-06-17T11:24:05.227-0300 [INFO]  client: using dynamic ports: min=20000 max=32000 reserved=14000-14512
    2025-06-17T11:24:05.259-0300 [WARN]  client.fingerprint_mgr.consul: failed to acquire consul self endpoint: cluster=default error="Get \"http://127.0.0.1:8500/v1/agent/self\": dial tcp 127.0.0.1:8500: connectex: No connection could be made because the target machine actively refused it."
    2025-06-17T11:24:05.330-0300 [WARN]  client.fingerprint_mgr.landlock: failed to fingerprint kernel landlock feature: error="landlock not supported on this platform"
    2025-06-17T11:24:05.528-0300 [ERROR] agent: error starting agent: error="client setup failed: fingerprinting failed: Error while detecting network interface  during fingerprinting: No default interface found with matching IP"

[Juanadelacuesta]

Hi @eusousu!

I tried running your initial configuration

data_dir = "C:/opt/nomad/data"
log_file = "C:/opt/nomad/logs/nomad.log"

server {
  enabled          = true
  bootstrap_expect = 1
}

client {
  enabled = true
}

plugin "raw_exec" {
  config {
    enabled = true
  }
}

On a 2025 windows server and it managed to get the server and client running without a problem. I do see from your logs the line:
2025-06-17T11:11:21.847-0300 [WARN] nomad: serf: Failed to re-join any previously known node it means your server is storing status from previous runs, make sure you either clean the C:/opt/nomad/data directory or use a different one for each run to avoid these issues.

Let us know if it helps!

[eusousu]

@Juanadelacuesta Hi!

I just tried deleting the nomad data folder and execute the configuration you provided. But still got the same error, now skipping the warn you mentioned

==> WARNING: mTLS is not configured - Nomad is not secure without mTLS!
==> WARNING: Bootstrap mode enabled! Potentially unsafe operation.
==> Loaded configuration from <config-path>
==> Starting Nomad agent...
==> Error starting agent: client setup failed: fingerprinting failed: Error while detecting network interface  during fingerprinting: No default interface found with matching IP
    2025-06-18T09:21:30.583-0300 [INFO]  nomad: setting up raft bolt store: no_freelist_sync=false
    2025-06-18T09:21:30.591-0300 [INFO]  nomad.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:<ID> Address:<default-gateway>:4647}]"
    2025-06-18T09:21:30.592-0300 [INFO]  nomad.raft: entering follower state: follower="Node at <default-gateway>:4647 [Follower]" leader-address= leader-id=
    2025-06-18T09:21:30.593-0300 [INFO]  nomad: serf: EventMemberJoin: <machine-name>.global <default-gateway>
    2025-06-18T09:21:30.593-0300 [INFO]  nomad: starting scheduling worker(s): num_workers=12 schedulers=["batch", "system", "sysbatch", "service", "_core"]
    2025-06-18T09:21:30.593-0300 [INFO]  nomad: started scheduling worker(s): num_workers=12 schedulers=["batch", "system", "sysbatch", "service", "_core"]
    2025-06-18T09:21:30.593-0300 [INFO]  nomad: adding server: server="<machine-name>.global (Addr: <default-gateway>:4647) (DC: dc1)"
    2025-06-18T09:21:30.593-0300 [WARN]  agent.plugin_loader: skipping external plugins since plugin_dir doesn't exist: plugin_dir=C:\opt\nomad\data\plugins
    2025-06-18T09:21:30.596-0300 [INFO]  agent: detected plugin: name=raw_exec type=driver plugin_version=0.1.0
    2025-06-18T09:21:30.596-0300 [INFO]  agent: detected plugin: name=exec type=driver plugin_version=0.1.0
    2025-06-18T09:21:30.597-0300 [INFO]  agent: detected plugin: name=qemu type=driver plugin_version=0.1.0
    2025-06-18T09:21:30.597-0300 [INFO]  agent: detected plugin: name=java type=driver plugin_version=0.1.0
    2025-06-18T09:21:30.597-0300 [INFO]  agent: detected plugin: name=docker type=driver plugin_version=0.1.0
    2025-06-18T09:21:30.598-0300 [INFO]  client: using state directory: state_dir=C:\opt\nomad\data\client
    2025-06-18T09:21:30.601-0300 [INFO]  client: using alloc directory: alloc_dir=C:\opt\nomad\data\alloc
    2025-06-18T09:21:30.601-0300 [INFO]  client: using dynamic ports: min=20000 max=32000 reserved=14000-14512
    2025-06-18T09:21:30.633-0300 [WARN]  client.fingerprint_mgr.consul: failed to acquire consul self endpoint: cluster=default error="Get \"http://127.0.0.1:8500/v1/agent/self\": dial tcp 127.0.0.1:8500: connectex: No connection could be made because the target machine actively refused it."
    2025-06-18T09:21:30.694-0300 [WARN]  client.fingerprint_mgr.landlock: failed to fingerprint kernel landlock feature: error="landlock not supported on this platform"
    2025-06-18T09:21:30.900-0300 [ERROR] agent: error starting agent: error="client setup failed: fingerprinting failed: Error while detecting network interface  during fingerprinting: No default interface found with matching IP"

one thing that bugs me is that the that nomad captures is from the vEthernet (WSL (Hyper-V firewall)) virtual adapter instead of the Npcap Loopback Adapter that has a higher priority 🤔.