Forums : Technical Issue Help
Dear Open Hub Users,
We’re excited to announce that we will be moving the Open Hub Forum to
https://community.synopsys.com/s/black-duck-open-hub.
Beginning immediately, users can head over,
register,
get technical help and discuss issue pertinent to the Open Hub. Registered users can also subscribe to Open Hub announcements here.
On May 1, 2020, we will be freezing https://www.openhub.net/forums and users will not be able to create new discussions. If you have any questions and concerns, please email us at
[email protected]
Fedora Packages - some enlistments failed for more than a month
Hello!
Fedora Packages is perhaps one of the biggest (if not the most biggest) ohloh's entry - it consists from more than 10 thousands enlistments. Unfortunately ~70 of them are failed (see full list of corresponding pages below).
I believe this is a symptom of more general issue - Ohloh constantly fails to fetch git repositories pushed with --force. Of course, some enlistments may fail due to some other (unrelated to --force) issue.
Also I'm wondering why one failed enlistment will prevent overall Projects' statistics recalculation?
Ok, here is a list of pages with failed enlistments:
- https://www.ohloh.net/p/fedora-packages/enlistments?page=3
- https://www.ohloh.net/p/fedora-packages/enlistments?page=24
- https://www.ohloh.net/p/fedora-packages/enlistments?page=37
- https://www.ohloh.net/p/fedora-packages/enlistments?page=57
- https://www.ohloh.net/p/fedora-packages/enlistments?page=70
- https://www.ohloh.net/p/fedora-packages/enlistments?page=73
- https://www.ohloh.net/p/fedora-packages/enlistments?page=74
- https://www.ohloh.net/p/fedora-packages/enlistments?page=75
- https://www.ohloh.net/p/fedora-packages/enlistments?page=78
- https://www.ohloh.net/p/fedora-packages/enlistments?page=82
- https://www.ohloh.net/p/fedora-packages/enlistments?page=103
- https://www.ohloh.net/p/fedora-packages/enlistments?page=152
- https://www.ohloh.net/p/fedora-packages/enlistments?page=165
- https://www.ohloh.net/p/fedora-packages/enlistments?page=167
- https://www.ohloh.net/p/fedora-packages/enlistments?page=179
- https://www.ohloh.net/p/fedora-packages/enlistments?page=190
- https://www.ohloh.net/p/fedora-packages/enlistments?page=202
- https://www.ohloh.net/p/fedora-packages/enlistments?page=217
- https://www.ohloh.net/p/fedora-packages/enlistments?page=224
- https://www.ohloh.net/p/fedora-packages/enlistments?page=231
- https://www.ohloh.net/p/fedora-packages/enlistments?page=250
- https://www.ohloh.net/p/fedora-packages/enlistments?page=264
- https://www.ohloh.net/p/fedora-packages/enlistments?page=270
- https://www.ohloh.net/p/fedora-packages/enlistments?page=317
- https://www.ohloh.net/p/fedora-packages/enlistments?page=331
- https://www.ohloh.net/p/fedora-packages/enlistments?page=356
- https://www.ohloh.net/p/fedora-packages/enlistments?page=364
- https://www.ohloh.net/p/fedora-packages/enlistments?page=367
- https://www.ohloh.net/p/fedora-packages/enlistments?page=383
- https://www.ohloh.net/p/fedora-packages/enlistments?page=399
- https://www.ohloh.net/p/fedora-packages/enlistments?page=448
- https://www.ohloh.net/p/fedora-packages/enlistments?page=456
- https://www.ohloh.net/p/fedora-packages/enlistments?page=471
- https://www.ohloh.net/p/fedora-packages/enlistments?page=488
- https://www.ohloh.net/p/fedora-packages/enlistments?page=491
- https://www.ohloh.net/p/fedora-packages/enlistments?page=497
- https://www.ohloh.net/p/fedora-packages/enlistments?page=498
- https://www.ohloh.net/p/fedora-packages/enlistments?page=528
- https://www.ohloh.net/p/fedora-packages/enlistments?page=538
- https://www.ohloh.net/p/fedora-packages/enlistments?page=552
- https://www.ohloh.net/p/fedora-packages/enlistments?page=558
- https://www.ohloh.net/p/fedora-packages/enlistments?page=559
- https://www.ohloh.net/p/fedora-packages/enlistments?page=567
- https://www.ohloh.net/p/fedora-packages/enlistments?page=716
- https://www.ohloh.net/p/fedora-packages/enlistments?page=743
- https://www.ohloh.net/p/fedora-packages/enlistments?page=745
- https://www.ohloh.net/p/fedora-packages/enlistments?page=762
- https://www.ohloh.net/p/fedora-packages/enlistments?page=784
- https://www.ohloh.net/p/fedora-packages/enlistments?page=879
- https://www.ohloh.net/p/fedora-packages/enlistments?page=929
- https://www.ohloh.net/p/fedora-packages/enlistments?page=933
- https://www.ohloh.net/p/fedora-packages/enlistments?page=952
- https://www.ohloh.net/p/fedora-packages/enlistments?page=962
- https://www.ohloh.net/p/fedora-packages/enlistments?page=972
- https://www.ohloh.net/p/fedora-packages/enlistments?page=984
- https://www.ohloh.net/p/fedora-packages/enlistments?page=988
- https://www.ohloh.net/p/fedora-packages/enlistments?page=1022
- https://www.ohloh.net/p/fedora-packages/enlistments?page=1026
- https://www.ohloh.net/p/fedora-packages/enlistments?page=1047
- https://www.ohloh.net/p/fedora-packages/enlistments?page=1084
Peter:
Hello
Fedora Packages is by far the largest in Ohloh.
Here at Black Duck we are still getting up to speed with all of Ohloh's intricacies. We're busy fixing bugs and working on the migration.
However we have spoke with Ohloh's original developers about the Fedora Packages project specifically.
Basically Ohloh wasn't designed to handle such a large number of enlistments and various problems occur due to this.
We've learned that Ohloh doesn't update Project stats until ALL the enlistments for a project pass successfully. Since this is unlikely with 10,000+ it's likely never going to update the stats.
Even if all 10,000 did pass, due to not being designed to handle so many, the resulting SQL queries and other operations that would take place at the end just time out.
In fact trying to go to the commits page just results in a timeout error most of the time.
I took a peek at some of the enlistments of fedora-packages. None of them appeared to have actual code in them, but rather just .spec and other text files. I saw a patch file here and there. I also found a package (and suspect more) that just had a dead.package file in them.
Are the majority of the enlistments mostly the same?
I don't have any answers for you right now, just wanted to let you know that we've talked about the fedora-packages problem and how we might deal with it and we'll be talking about it more in the future.
Are the majority of the enlistments mostly the same?
Yes. Almost all these repositories are very sparse
Looks like Fedora Packages has been stuck ever since:
The code analysis was last completed 5 months ago (based on source code collected on Aug 14 2010)
Have any of the numerous improvements you guys have done on Ohloh in the past half a year made handling such large number of packages easier?
