osdir.com


[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

[stackalytics] Reported numbers seem inaccurate


On Mon, Apr 15, 2019, at 17:20, Julia Kreger wrote:
> In working on the project update for Ironic, I too have noticed wild
> inaccuracies.
> 
> For one contributor, I found it reported 1 commit for a specific
> contributor in one screen, but when looking at the data differently
> that same user showed four different commits.
> 
> Looking at the commit count reporting for ironic-group, it also only
> shows about 200 commits for stein, but when I manually dump the data
> out from the `git log` output I count in excess of 600 commits.
> 
> It also reported like 63 contributors for stein, but I get 123 based
> on just the commit log author/co-authored-by data. I totally get that
> there are lots of edge cases to cover in any UI to show insight, but
> the data just does not seem like it is accurately reporting.
> 
> Is it time for us, as a community, to whip up something that helps
> provide basic insight?

I too found that stackalytics was wildly unuseful for preparing data for project updates. I started using reviewstats[1] (after learning about it from another thread) which provided a much better starting point. So I don't think we need to whip up something new, we should make that thing better.

[1] https://opendev.org/openstack-infra/reviewstats

Colleen

> 
> -Julia
> 
> On Thu, Apr 11, 2019 at 11:29 AM Mark Goddard <mark at stackhpc.com> wrote:
> >
> > Hi,
> >
> > I've heard a couple of people say they don't feel the numbers reported by Stackalytics accurately reflect reality. I've been trying to gather a few stats for my Kolla update session in Denver, and am finding the same. I'll try to give some concrete examples.
> >
> > Reviews for all kolla deliverables in Stein [1]. Here the company stats don't reflect the individual stats. Also, the total reviews in the 'Kolla Official' module does not equal the sum of the reviews of its submodules (kolla, kolla-ansible, kolla-cli).
> >
> > If I look at the contribution summary for Kolla Official in the last 90 days [2], they are actually greater than those for the last 180 days [3]!
> >
> > There are also similar issues with commit metrics, and none seem to match what I see in git.
> >
> > Thanks,
> > Mark
> >
> > [1] https://www.stackalytics.com/?metric=marks&module=kolla-group
> > [2] https://www.stackalytics.com/report/contribution/kolla-group/90
> > [3] https://www.stackalytics.com/report/contribution/kolla-group/180
> 
>