Forums : Technical Issue Help

It seems that the statistics of the project [Fedora Packages](https://www.ohloh.net/p/fedora-packages) has not been updated since quite a while. It is unclear from the main page what the reason is.

The project has a lot of repositories, and quite some seem to have failed over a year ago (like abrt), but are in fact actively maintained (url has not changed either).

Any ideas if this could get fixed? Or, at a minimal have something about the incomplete stats mentioned on the main project page?

Thanks!

Niels de Vos almost 11 years ago

Niels,

You have had 1291 enlistment failures our of 1189 enlistments. I think it would be fair to say this is a flipping disaster. I can't even imagine how I would go about fixing a massive mess such as this. It's clear that there are multiple causes for this but something happened 612 days ago that caused the majority of the failures. It looks to be an internal error here at ohloh which must have been compounded by some other factor.

I will start to unravel the mystery here and very certainly pass this on to the gurus in management to see if they can do their magic to sort this all out. The answer may not be pleasant.

Standby.

ssnow-blackduck almost 11 years ago

Thanks, its much appreciated that you're looking into it.

Niels de Vos almost 11 years ago

Hi!
I'm wondering whether there's any progress here?

Lubomir Rintel over 10 years ago

Lubomir,

Actually, I have been putting some hours into it the last couple of days. I have cleaned up all the stalled initial fetches and am working on the updates that are similarly hung. It appears that this is a good incubator for all kinds of failures in one place and I've been adding some useful tools that can help us keep things moving along. At this point, it seems to be just grunt work now getting the hundreds of failed updates re-started.

Will keep you all updated here as I progress.

Thanks!

ssnow-blackduck over 10 years ago

Good to know this is being worked upon. Thanks for looking into this. There are a lot of sources in the Fedora gits, and I can imagine how much work it is to manually check for failures.

sanjay_ankur over 10 years ago

Sanjay,

Just imagine what a mess it is in the middle of an update. Good thing I'm not prone to migraine headaches! We've made some progress but it's apparent I'll need some more time to clear up all the failures.

Will report back once I have more information.

Thanks!

ssnow-blackduck over 10 years ago

Sanjay,

Fixed a few problems today and then an update flooded in and it's tough to see with all the activity.

There are currently 11894 enlistments in the project. This is really unmanageable. There are 47,000 jobs in various states give-or-take to work through and only a very small subset are in need of attention, but how to find them. Each series of updates creates its own failures, seemingly randomly.

Your thoughts...

ssnow-blackduck over 10 years ago

I'm not really sure. Like I said, handling all those repositories was always going to be quite difficult. Any idea on what causes the errors? Were all the errors that you fixed caused by similar issue? If it's something in the Fedora repos that causes these hold ups/errors, I can ask fedora-infra to look into it. If it's on the ohloh end, however, i have no idea how to proceed at the moment. Anything you can tell us about the issues would be helpful: error messages/logs?

sanjay_ankur over 10 years ago

Sanjay,

There are a series of a few recurrent errors. Some fix themselves over time and some require manual intervention. At this point I don't see any immediate need to contact the infrastructure folks since I'm not aware of any obvious failures from that end. (The repositories seem to be surprisingly robust for all the work we put them through...)

I'll send on an e-mail with some examples of the kinds of errors I see.

Thanks!

ssnow-blackduck over 10 years ago

Sanjay,

Things are looking up today. Somehow, we are close to an analysis and have one in the in the rear-view mirror (today at 03:17:46AM GMT). I will keep an eye on it through the day. An analysis must take many hours by itself...

Thanks!

ssnow-blackduck over 10 years ago

Sanjay,

Analyzed on Monday, December 09, 2013 based on code collected on Monday, December 09, 2013. (about 1 hour ago.)

Please update me here if the project hangs up again.

Thanks!

ssnow-blackduck over 10 years ago

Ah! Great! I was in conversation with Ralph (the manager for this project) and we were trying to see if there were any issues on the Fedora infra side causing the issues you outlined in your mail. It's great that it's fixed, though. Thanks a bunch.

PS: The list of source repositories isn't complete. More packages were added to Fedora since the initial setup here on Ohloh. I'll probably add the missing ones sometime this week and keep an eye out for any hangs.

Thanks a bunch :)

sanjay_ankur over 10 years ago

Hi!

I've generated a list of repositories (source locations) that aren't yet added to ohloh. There are actually about 6000 of them. These are packages that were added to Fedora after the initial import into Ohloh. I've been looking through the API, but it seems to be limited to querying the database. Is there a way I can use it to write a script that would add these?

I tried adding them via the website, but it gives me a 502.

Here are the lists. A simple diff generates the missing entries:
http://ankursinha.fedorapeople.org/ohloh/fedora-complete-packagedb-list.txt
http://ankursinha.fedorapeople.org/ohloh/fedora-ohloh-scm-urls-all.txt

Thanks,
Warm regards,
Ankur

sanjay_ankur over 10 years ago

Sanjay,

I'm not sure what I can suggest. I know somebody out there has used a script to enter additional enlistments but I've never seen details. You may need to appeal to the user community at large to get some assistance with that request. Also, I need to question the wisdom of adding that many more enlistments when the project as it is will be unstable. To add one-third more enlistments to the current nearly twelve thousand enlistments seems unlikely to succeed. Every added enlistment is one more potential source of failure. Perhaps a more effective plan would to be trying to organize the individual projects around some common factor in the enlistments and then summarize the results in an ohloh organization that would show the cumulative result. It would be more work but would have a better chance of success than the current path. Think about subdividing the current 12 thousand enlistments among say half a dozen projects grouped by a common theme then add another series of projects to contain the added 6000 enlistments. The chances of success would be multiplied by this method. Please check out ohloh organizations and see if they provide the level of detail that you might require. See: https://www.ohloh.net/orgs

Thanks!

ssnow-blackduck over 10 years ago

I'll check out the organization bit. The thing is that the organizations are upstreams. Fedora as a distribution collects and puts together packages from many such upstreams, and as a result, the source code for our packages is much larger.

I'll talk to others in the community and see if we can find a solution. Thanks.

sanjay_ankur over 10 years ago

Sanjay,

An ohloh Organization is a convenient way to get cumulative figures across a number of projects. I just don't know if they are offered with the level of detail you can get currently with a project. If so, the ideal situation would be a constellation of projects perhaps limited to one-third of the size of the current Fedora Packages project and linked thematically (one for utilities, maybe, one for languages, one for build tools etc.) and the statistics come together in a Fedora Packages organization. If the current project grows it will be beyond my ability to keep it working smoothly. As it is, I don't have the spare time to shepherd it every time the internet burps or the repository takes a time out.

Thanks!

ssnow-blackduck over 10 years ago