Forums : Suggestions for Ohloh 2.0

Apache Synapse recently became a Top ...

Apache Synapse recently became a Top Level Project (TLP) of the Apache Software Foundation and thus moved into our own domain synapse.apache.org

This required that we move our SVN as well, and now ohloh thinks that Synapse is just one month old ?! Can someone fix this issue ASAP..

C773a127314f03e1294089a7326034dc?&s=42&rating=pg&d=http%3a%2f%2fopenhub.net%2fanon80
asankha over 9 years ago
 

Sorry, asankha, you've just bumped up against a limitation of the Ohloh Subversion importer. We are unable to follow development activity across branches or directory moves.

If you get your log using the --stop-on-copy option, you will see your project the way Ohloh sees it.

As far as I can tell there is no workaround. This affects a lot of projects, and I desperately want to get this fixed, but it will take some time.

Robin

063ffe4b4061aa874f09216cfd60d8f2?&s=42&rating=pg&d=http%3a%2f%2fopenhub.net%2fanon80
Robin Luckey over 9 years ago
 

Robin

This is just not good enough.. if ohloh can't even track such a common svn switch which affects "a lot of projects" and you cannot fix this even in 4 months, I think someone should start blogging on how ineffective ohloh would be under these circumstances.. Can you give me an ETA for this fix?

asankha

C773a127314f03e1294089a7326034dc?&s=42&rating=pg&d=http%3a%2f%2fopenhub.net%2fanon80
asankha about 9 years ago
 

Asankha,

As you've surmised, fixing this problem hasn't been our highest priority. As much as we hate to disappoint anyone, this problem simply doesn't rank as high as driving & monetizing ohloh adoption. Unfortunately, there is no current ETA.

There are work arounds: you could create an historical Synapse repository and add it to your project, for example.

Meanwhile, I sincerely encourage you to blog about Ohloh as often as you can - we could always use the coverage.

9dbaca493199c57710e53b56310f659d?&s=42&rating=pg&d=http%3a%2f%2fopenhub.net%2fanon80
Jason Allen about 9 years ago
 

Jason

I tried to create a historical repository.. but it seems like it suffers from the same problem since what I can do is a "svn cp..." and the "--stop-on-copy" option makes that useless..

Can you help me with some details on how could try your suggested workaround?

asankha

C773a127314f03e1294089a7326034dc?&s=42&rating=pg&d=http%3a%2f%2fopenhub.net%2fanon80
asankha about 9 years ago
 

So you want coverage? Well, given all the features that people report so often and developers "have no time to work on because of so many other features in the list", add me on the survey as "wouldn't (yet) recommend Ohloh to other open source projects".

Every feature I'm interested in seems to be low on list compared to others. Wonder which are the others?

15962db3bafebdaa725a4c5709ccd932?&s=42&rating=pg&d=http%3a%2f%2fopenhub.net%2fanon80
nicolas-17 almost 9 years ago
 

@asankha - I kinda dropped you in the deep-end - sorry about that. Here's some more prescriptive steps that I believe should work (no guarantees though).

  1. Clone your synapse subversion trunk into Git - git-svn clone http://svn.apache.org/repos/asf/synapse/trunk/java synapse
  2. Find the SHA1 of the commit that resulted in the promotion of SYNAPSE into its own tree.
  3. Git revert just prior to that commit.
  4. Now create a new Git commit containing the deletion of all files in this new Git repo.
  5. Move this "historical GIT tree" up to a publicly accessible place (github?).
  6. Enlist your ohloh project into this historical tree.

Wheh! This should, theoretically, solve the problem. YOu might run into problems along the way. Contact me via ohloh messaging (@jason) or jabber(jasonallen@gmail.com) if you run into any problem/questions.

9dbaca493199c57710e53b56310f659d?&s=42&rating=pg&d=http%3a%2f%2fopenhub.net%2fanon80
Jason Allen almost 9 years ago
 

@nicolas-17 I hear your frustration. We're a small team w/ a lot manage. I think I clearly stated our focus above (monetization).

Btw, I'm always up for a chat on Ohloh's defiencies (or praises!). Come join our IRC conversation on #ohloh at irc.freenode.net (or Jabber at jasonallen@gmail.com). Peace!

9dbaca493199c57710e53b56310f659d?&s=42&rating=pg&d=http%3a%2f%2fopenhub.net%2fanon80
Jason Allen almost 9 years ago
 

Hi Jason

Thanks for your guidelines, I think I can again believe this is somehow possible now..

I tried your steps, but run into some issues.. btw this is my first time with git.. hope you can help me

asankha@asankha:~/GIT$ git-svn clone http://svn.apache.org/repos/asf/synapse/trunk/java synapse Initialized empty Git repository in .git/ W: Ignoring error from SVN, path probably does not exist: (175007): HTTP Path Not Found: REPORT request failed on '/repos/asf/!svn/bc/100/synapse/trunk/java': '/repos/asf/!svn/bc/100/synapse/trunk/java' path not found

After that it almost seems like its done.. or stuck.. and inside the synapse directory created, I see no files :(..

Can you try to replicate the Synapse repo to see if there is some problems with it?

thanks asankha

C773a127314f03e1294089a7326034dc?&s=42&rating=pg&d=http%3a%2f%2fopenhub.net%2fanon80
asankha almost 9 years ago
 

Hi asankha,

I tried running it locally here at the ohloh offices, but didn't get anywhere because our friends at apache have turned off access from the ohloh offices (they didn't like an early version of our crawler... long story). I'll attempt again later tonight from home.

9dbaca493199c57710e53b56310f659d?&s=42&rating=pg&d=http%3a%2f%2fopenhub.net%2fanon80
Jason Allen almost 9 years ago
 

ok - I'm running it from home and it appears to be importing. It's taking quite a while so I'll let it run overnight. Btw, I ran this command:

svn clone --trunk=trunk --tags=tags --branches=branches http://svn.apache.org/repos/asf/synapse

I'll report back in the morning.

9dbaca493199c57710e53b56310f659d?&s=42&rating=pg&d=http%3a%2f%2fopenhub.net%2fanon80
Jason Allen almost 9 years ago
 

Hi Jason

Did your clone complete successfully? When I try that, I still get the warning below:

asankha@asankha:~/GIT$ git svn clone --trunk=trunk --tags=tags --branches=branches http://svn.apache.org/repos/asf/synapse Initialized empty Git repository in .git/ Using higher level of URL: http://svn.apache.org/repos/asf/synapse => http://svn.apache.org/repos/asf W: Ignoring error from SVN, path probably does not exist: (160013): Filesystem has no item: REPORT request failed on '/repos/asf/!svn/bc/100': File not found: revision 100, path '/synapse'

But it only pulls down 168K of stuff :(

asankha@asankha:~/GIT$ du -h 108K ./synapse/.git/svn/trunk 112K ./synapse/.git/svn 4.0K ./synapse/.git/info 0 ./synapse/.git/refs/tags 0 ./synapse/.git/refs/heads 0 ./synapse/.git/refs 40K ./synapse/.git/hooks 0 ./synapse/.git/branches 0 ./synapse/.git/objects/info 0 ./synapse/.git/objects/pack 0 ./synapse/.git/objects 168K ./synapse/.git 168K ./synapse 168K .

Hopefully I am doing something wrong ?

thanks asankha

C773a127314f03e1294089a7326034dc?&s=42&rating=pg&d=http%3a%2f%2fopenhub.net%2fanon80
asankha almost 9 years ago
 

Jason

I left the git clone running from morning till evening, and here is what I got:

asankha@asankha:~/GIT$ git svn clone --trunk=trunk --tags=tags --branches=branches http://svn.apache.org/repos/asf/synapse Initialized empty Git repository in .git/ Using higher level of URL: http://svn.apache.org/repos/asf/synapse => http://svn.apache.org/repos/asf W: Ignoring error from SVN, path probably does not exist: (160013): Filesystem has no item: REPORT request failed on '/repos/asf/!svn/bc/100': File not found: revision 100, path '/synapse' W: Ignoring error from SVN, path probably does not exist: (175002): RA layer request failed: PROPFIND request failed on '/repos/asf/!svn/vcc/default': PROPFIND of '/repos/asf/!svn/vcc/default': 502 Bad Gateway (http://svn.apache.org) W: Ignoring error from SVN, path probably does not exist: (175002): RA layer request failed: PROPFIND request failed on '/repos/asf': PROPFIND of '/repos/asf': could not connect to server (http://svn.apache.org) Path 'synapse' was probably deleted: RA layer request failed: PROPFIND request failed on '/repos/asf': PROPFIND of '/repos/asf': could not connect to server (http://svn.apache.org) Will attempt to follow revisions r675401 .. r675436 committed before the deletion

It however created a file 27MB, and full of just "0" (zeros!) and nothing else: .git/svn/trunk/.rev_db.13f79535-47bb-0310-9956-ffa450edef68

If you were able to get anywhere, please give me the full commands that works

thanks asankha

C773a127314f03e1294089a7326034dc?&s=42&rating=pg&d=http%3a%2f%2fopenhub.net%2fanon80
asankha almost 9 years ago
 

hi asankha. Saw your post on MARC. I'm trying to install the latest Git from HEAD to see if the later ones work.

I suspect one of the problems we might be running into is the fact that the Apache Svn repo is one single GIANT repo. Might be the cause of the weird behaviour.

Anyway - i'll try again and report back...

9dbaca493199c57710e53b56310f659d?&s=42&rating=pg&d=http%3a%2f%2fopenhub.net%2fanon80
Jason Allen almost 9 years ago
 

Hi Jason

Any luck with the latest Git? I understand that Apache SVN maybe one of the largest repos around, and its going to be difficult to try many options.. Why does Ohloh depend on the "--stop-on-copy" option? Can there be a workaround to overcome this limitation while still using SVN?

thanks asankha

C773a127314f03e1294089a7326034dc?&s=42&rating=pg&d=http%3a%2f%2fopenhub.net%2fanon80
asankha almost 9 years ago
 

Hi Jason

I am hoping/waiting to hear from good news from your side on this issue.. have you had any luck with the latest Git?

thanks asankha

C773a127314f03e1294089a7326034dc?&s=42&rating=pg&d=http%3a%2f%2fopenhub.net%2fanon80
asankha almost 9 years ago
 

I'd just like to drop something in:

asankha, please remember that Ohloh is still a free (as in free beer ;)) service. I think we all should have no claims or wishes that the Ohloh staff needs to do "ASAP". Just waiting for an answer is enough - The Ohloh boys and girls will work on your issue once they have fixed more important things.

01c45a7b72ffe50e16476d1fd74968ad?&s=42&rating=pg&d=http%3a%2f%2fopenhub.net%2fanon80
Lennart Koopmann almost 9 years ago
 

Hi Lennart

I appreciate that Ohloh is still a free service.. but for whom? Anyone at Ohloh wouldn't possibly expect other open source - and of course free software projects - which after all makes up ohloh - to pay to get listed?

You may notice if you look carefully that many other open source projects (including many at ASF) are affected by this "not so important" issue to you..

However, I cannot figure out why you wanted to make this comment - when AFAIK you are not one of the core engineers of Ohloh.. and you clearly misunderstood my note to Jason (the chief geek at Ohloh) if you thought that I asked the "Ohloh staff" to do this enhancement "ASAP".. ??

asankha

C773a127314f03e1294089a7326034dc?&s=42&rating=pg&d=http%3a%2f%2fopenhub.net%2fanon80
asankha almost 9 years ago
 

Jason

Is the code that drives Ohloh code stats open source? Just wondering if I could be of any help to fix this issue..

thanks asankha

C773a127314f03e1294089a7326034dc?&s=42&rating=pg&d=http%3a%2f%2fopenhub.net%2fanon80
asankha over 8 years ago
 

Jason

The Synapse repo is now available in read-only mode on Git at http://jukka.zitting.name/git/?p=synapse.git;a=summary

What will it now require for the enlistment to get the correct history? I am a newbie to Git, so appreciate if someone could help me here..

thanks asankha

C773a127314f03e1294089a7326034dc?&s=42&rating=pg&d=http%3a%2f%2fopenhub.net%2fanon80
asankha over 8 years ago
 

Post a Response