contribs.txt not updating?

[jeremydouglass]

(accidentally posted to processing/processing#6208 -- reposting here)

Example:

https://raw.githubusercontent.com/processing/processing-docs/master/contrib_generate/sources.conf

lists:

220 \ https://github.com/processing-r/Processing.R/releases/latest/download/RLangMode.txt

The file RLangMode.txt lists:

version = 109
prettyVersion = v1.0.9

however

http://download.processing.org/contribs

lists

prettyVersion=v1.0.7
maxVersion=0
paragraph=
version=107

which was last true four days ago. This is the same file that is being download by PDE as contribs.txt and listed in Library Manager.

So, Processing.R 108 was released three days ago, 109 yesterday -- so it seems like whatever process is building contribs.txt is taking more than three days? Is this expected, or has the process failed?

---

@prisonerjohn -- I'm not sure if I should ping you on this.

I tried to do more investigating, but the role of contribs.txt vs. sources.conf isn't described at all in the wiki docs on distribution -- it only describes PDE downloading sources.conf directly, which I'm guessing that description is out of date since ~2014/15

[prisonerjohn]

Thank you @jeremydouglass
We are in the process of updating all this, the generation script got lost in the shuffle of the new website. It'll be working again shortly.

[jeremydouglass]

Great news, @prisonerjohn. It will really help with updating modes / libraries and getting the latest changes in front of Processing 3 / 4 users.

[jeremydouglass]

Hi @prisonerjohn -- just wanted to ping on this. Anything I can do to help get mode and library updating working again? Unless it is a more specific scraping problem for the test cases I'm examining, I think it is still not working, and if so I think that means no contribution updates can be detected by PDE from any contributor....

[prisonerjohn]

Hi @jeremydouglass
This should be working again now, and updating the list daily automatically.
Let me know if you're running into any issues.

[jeremydouglass]

Thanks @prisonerjohn. I just repeated the same test and it seems to fail:

1. load sources https://raw.githubusercontent.com/processing/processing-docs/master/contrib_generate/sources.conf
2. load 220 \ https://github.com/processing-r/Processing.R/releases/latest/download/RLangMode.txt
   • version = 109
3. load http://download.processing.org/contribs
   • version = 107
4. open PDE
   • version v1.0.7 available

So the mode and its listed .txt are still 109, and /contribs and PDE contributions manager are still 107.

It seems like the source files in sources.conf still aren't having their data copied over to /contribs?

[prisonerjohn]

We are not using this repo anymore, so you won't see updates here.
However, https://download.processing.org/contribs is reporting version 109 for me, maybe you're loading a cached version?

[jeremydouglass]

I can see the update on /contribs now. Maybe just a cache / delay. Thank you!

When you say:

We are not using this repo anymore, so you won't see updates here.

Do you mean:

• that sources.conf is now being sourced from another repo, or elsewhere?
• and/or that this processing/processing-docs repo is being archived in favor or processing/processing-website, or something else?

I ask because I can't find anything like contrib-generate or sources.conf on any other repo. Being able to inspect the current catalog data would be very helpful when supporting tool and library authors who are dealing with sync problems.

[jeremydouglass]

Okay, so http://download.processing.org/contribs is showing the old version (Processing.R 107), https://download.processing.org/contribs is showing the new version (Processing.R 109). So that's why I was confused -- I was checking the old http url, and the new https url is where the update happened.

Also, perhaps Processing 3.5.4 might be checking the out-of-date http version, not the updated https version...? I'm not seeing a refresh in Contributions Manager after multiple restarts.

[prisonerjohn]

Good catch, we are looking into it. cc @benfry

As for your question, this repo is being archived in favor of another one that is just used for managing contributions. It's currently private but we can make it public once all the dust settles.

[benfry]

Sorry about that, had missed another path that needed to be updated. All set now.

[jeremydouglass]

Thank you! Confirming that everything looks good -- urls updated, Contribution Manager displayed versions in 3.5.4, and installs performed correctly.