# Description

We had data races in the UT mirroring tests because we were changing the
actual slice passed to the transformer instead of creating a copy.

Once that was fixed, the tests showed that we were using the wrong
golden file (i.e. `goldenUtMirrorClientEvents.json` should have had the
original client events and not the transformer response).

Additionally, if a difference was detected between the original
transformer and the mirrored one, we'd upload the original `eventList`
concurrently. To avoid further races we're not passing a hard copy.

## Linear Ticket

< [Linear
Ticket](https://linear.app/rudderstack/issue/PIPE-2385/ut-mirroring-test-failure)
>

## Security

- [x] The code changed/added as part of this pull request won't create
any security issues with how the software is being used.

# Description

 Upgrade build-scan-push-action to the latest version

## Linear Ticket


## Security

- [ ] The code changed/added as part of this pull request won't create
any security issues with how the software is being used.

# Description

Syncing release v1.59.0 to main branch

**WARNING: Do NOT rewrite git history and ALWAYS use a "Merge Commit"
for merging!**

**↓↓ Please review and edit commit overrides before merging ↓↓**

BEGIN_COMMIT_OVERRIDE
fix: ut mirroring tests (#6341)
chore: upgrade build-scan-push-action to v1.8.0 (#6350)
END_COMMIT_OVERRIDE

# Description

Syncing patch release v1.59.1 to main branch

**↓↓ Please review and edit commit overrides before merging ↓↓**

BEGIN_COMMIT_OVERRIDE
fix: add outgoing metrics to proxy flow (#6355)
fix: aws session config region (#6354)
END_COMMIT_OVERRIDE

---------

Co-authored-by: Dilip Kola <[email protected]>
Co-authored-by: Akash Chetty <[email protected]>

# Description

Fixing dedup gauge.

## Linear Ticket

Fixes
[PIPE-2402](https://linear.app/rudderstack/issue/PIPE-2402/fix-rudder-server-dedup-gauge)

## Security

- [x] The code changed/added as part of this pull request won't create
any security issues with how the software is being used.

# Description

Syncing patch release v1.59.2 to main branch

**↓↓ Please review and edit commit overrides before merging ↓↓**

BEGIN_COMMIT_OVERRIDE
fix: add outgoing metrics to proxy flow (#6355)
fix: aws session config region (#6354)
fix: missing keydb client stats (#6360)
END_COMMIT_OVERRIDE

---------

Co-authored-by: Dilip Kola <[email protected]>
Co-authored-by: Akash Chetty <[email protected]>
Co-authored-by: Francesco Casula <[email protected]>

# Description

We are adding a readme to asyncdestinaiton manager to understand and
onboard a new async integration.

## Linear Ticket


https://linear.app/rudderstack/issue/INT-4136/create-read-me-for-async-destinations

## Security

- [ ] The code changed/added as part of this pull request won't create
any security issues with how the software is being used.

Co-authored-by: Sudip Paul <[email protected]>

# Description

Syncing patch release v1.59.3 to main branch

**↓↓ Please review and edit commit overrides before merging ↓↓**

BEGIN_COMMIT_OVERRIDE
fix: naming collision in redis throttling configuration (#6365)
END_COMMIT_OVERRIDE

---------

Co-authored-by: Dilip Kola <[email protected]>
Co-authored-by: Akash Chetty <[email protected]>
Co-authored-by: Francesco Casula <[email protected]>
Co-authored-by: Aris Tzoumas <[email protected]>
Co-authored-by: Aris Tzoumas <[email protected]>

# Description

Syncing patch release v1.59.4 to main branch

**↓↓ Please review and edit commit overrides before merging ↓↓**

BEGIN_COMMIT_OVERRIDE
fix: keydb grpc config (#6370)
END_COMMIT_OVERRIDE

---------

Co-authored-by: Dilip Kola <[email protected]>
Co-authored-by: Akash Chetty <[email protected]>
Co-authored-by: Francesco Casula <[email protected]>
Co-authored-by: Aris Tzoumas <[email protected]>

# Description

Removing deprecated throttling configuration keys

## Linear Ticket

resolves PIPE-2376

## Security

- [x] The code changed/added as part of this pull request won't create
any security issues with how the software is being used.

# Description

This PR adds explicit workflow permissions.  
By default, if a workflow does not define its own permissions, it
inherits the repository’s permissions.

## Linear Ticket


[PIPE-2424](https://linear.app/rudderstack/issue/PIPE-2424/manage-git-token-permissions-in-git-workflows)

## Security

- [ ] The code changed/added as part of this pull request won't create
any security issues with how the software is being used.

…imit (#6338)

# Description

Routers with destination isolation enabled are now able to adapt their
jobsdb pickup query batch size dynamically based on the destination's
current throttling limit.

- This feature can be enabled through the hierarchical configuration
options (default: **`false`**)
  - `Router.<DEST_TYPE>.pickupQueryThrottlingEnabled` 
  - `Router.pickupQueryThrottlingEnabled`.
- If the destination is using a single throttler for all event types,
the pickup query batch size will match the current throttling limit.
- If the destination is using a different throttlers per event type, the
pickup query batch size will match the sum of all current throttling
limits that have been recently used (within `readSleepSeconds*2`).
- There is an upper limit on the maximum pickup query batch size
controlled through (default: **`10000`**)
  - `Router.<DEST_TYPE>.maxJobQueryBatchSize` 
  - `Router.maxJobQueryBatchSize`

By dynamically adjusting the pickup query batch size to match the
destination’s current throttling limits, routers no longer over-fetch
jobs that cannot be processed immediately. This reduces the number of
jobs queried from the database only to be discarded later due to
throttling constraints. The result is lower query overhead, more
efficient use of system resources, and faster end-to-end job processing
since only jobs that can realistically be delivered are retrieved and no
sleep penalty is added in the pickup loop due to less discarded jobs
(for high job discard ratios (>60%) we impose a sleep penalty of 5
seconds per loop as a back-pressure mechanism).

## Linear Ticket

resolves PIPE-2375

## Security

- [x] The code changed/added as part of this pull request won't create
any security issues with how the software is being used.

# Description
- We are making Reporting Service internal and enforcing authentication
on all APIs.
- The change in this PR is to add authentication to the common reporting
client and use `REPORTING_USERNAME` and `REPORTING_PASSWORD` envs.



## Linear Ticket

Fixes OBS-909

## Security

- [ ] The code changed/added as part of this pull request won't create
any security issues with how the software is being used.

# Description

- Set table type as external for Glue tables

## Linear Ticket

- Resolves WAR-1177

## Security

- [x] The code changed/added as part of this pull request won't create
any security issues with how the software is being used.

<!-- CURSOR_SUMMARY -->
---

> [!NOTE]
> Ensure AWS Glue tables are created and updated as EXTERNAL_TABLE, with
tests asserting the table type.
> 
> - **Glue schema repository**:
> - Set `TableType` to `EXTERNAL_TABLE` in `CreateTable` and
`updateTable`.
> - **Tests**:
>   - Assert created table `TableType` is `EXTERNAL_TABLE`.
>   - Add missing `require.NoError` after `AddColumns`.
> 
> <sup>Written by [Cursor
Bugbot](https://cursor.com/dashboard?tab=bugbot) for commit
e00eb99. This will update automatically
on new commits. Configure
[here](https://cursor.com/dashboard?tab=bugbot).</sup>
<!-- /CURSOR_SUMMARY -->

🤖 I have created a release *beep* *boop*
---


##
[1.60.0-rc.1](v1.59.0...v1.60.0-rc.1)
(2025-09-29)


### Features

* **router:** jobsdb pickup query batch size adapting to throttling
limit ([#6338](#6338))
([c38b971](c38b971))


### Bug Fixes

* add outgoing metrics to proxy flow
([#6355](#6355))
([23a5c81](23a5c81))
* aws session config region
([#6354](#6354))
([23a5c81](23a5c81))
* dedup gauge
([#6359](#6359))
([a562df4](a562df4))
* keydb grpc config
([#6370](#6370))
([cf04743](cf04743))
* missing keydb client stats
([#6360](#6360))
([c42e5c8](c42e5c8))
* naming collision in redis throttling configuration
([#6365](#6365))
([4f87afb](4f87afb))
* set table type to external for glue
([#6386](#6386))
([9017582](9017582))
* ut mirroring tests
([#6341](#6341))
([51dd4f7](51dd4f7))
* **warehouse:** alter namespace col size
([#6379](#6379))
([fbba498](fbba498))
* **warehouse:** skip extract async job failing test
([#6378](#6378))
([89a4d1e](89a4d1e))


### Miscellaneous

* add authentication to reporting client
([#6384](#6384))
([502d2b0](502d2b0))
* add explicit permissions for workflows
([#6381](#6381))
([1d22623](1d22623))
* add readme for async destinaiton module
([#6356](#6356))
([cc80333](cc80333))
* remove deprecated throttling configuration keys
([#6377](#6377))
([8d667b7](8d667b7))
* upgrade build-scan-push-action to v1.8.0
([#6350](#6350))
([51dd4f7](51dd4f7))

---
This PR was generated with [Release
Please](https://github.com/googleapis/release-please). See
[documentation](https://github.com/googleapis/release-please#release-please).