5 ms·

I was really into exercism before they changed the interface. And I know that change is good, but the peer mentorship I got when the previous interface existed

I was really into exercism before they changed the interface. And I know that change is good, but the peer mentorship I got when the previous interface existed was decent, and at least pretty consistent. With the new interface, I need to wait for official mentors, and while some have been way above and beyond, the dearth of reactions from anyone for long periods can be a real downer. I preferred the semi-OK amateur mentorship over the wildly inconsistent/non-existent mentor assistance. There was one mentor that I would have happily paid directly to keep giving me feedback, but there was no mechanism in exercism for me to make that offer, even if exercism took a cut. Also in the old interface, the community solutions were sorted by recency, so it was easier to interact with other fellow learners, and the new interface is not that, I'm not sure what the order is, but it's of no use for me to comment on a piece of code submitted two years ago.

ihid 8y ago
> I preferred the semi-OK amateur mentorship over the wildly inconsistent/non-existent mentor assistance. Just to chime in with data here, there is 5x more feedback per day on the new system than there was with the old system. Depending on the track, you'll get feedback in 3hrs to 7days (very occasionally longer), so it is definitely inconsistent in that respect, but you will get feedback. In the old system, you'd get feedback at all in under 10% of submissions. > There was one mentor that I would have happily paid directly to keep giving me feedback, but there was no mechanism in exercism for me to make that offer, even if exercism took a cut. In the future we'll be adding the ability to "pair" mentor/mentees who have both rated the other highly, so this will sort-of happen for you.
- codezero 8y ago
  How do you define feedback? I got things like kudos etc... and comments which were helpful, I would have considered either one feedback. In general, there seemed to be more interaction, regardless of whether you call it feedback, or social validation. The pair mentor/mentee sounds good, I look forward to it!
  - ihid 8y ago
    So there are two modes: 1) Mentored Mode: Submit, get structured feedback from mentors, then publish and get stars (ie upvotes/kudos) and/or public comments. 2) Independent Mode: Submit, publish, get stars (ie upvotes/kudos) and/or public comments. So Independent Mode is very similar to "classic" Exercism. I'm defining "feedback" really as (1) - so there are 5x more comments (from mentors + public) now than there were in old Exercism (public). So for a tangible example: - Feb 1st 2018 (classic): 162 comments, 110 stars - Feb 1st 2019 (new): 831 comments, 46 stars I randomly picked that date, but every date is basically the same sort of ratio. Lots of people say the same as you do that it feels like there's less interaction, but really there's a lot more. I feel like we're failing to make Exercism feel as alive as it actually is for some reason, but I'm not sure why :)
    - codezero 8y ago
      Are these numbers normalized to the number of people making the interactions? or the number of learners? Did you have 5x growth over the past year? Sorry, I am kind of being critical, but mainly because my experienced degraded so much. I trust you to run the place in what ever way you see fit, and any gripe I have is because I really want exercism to work for me. It's the best way I've up-leveled my skills outside of coding on the job, and I really feel like I hit a huge speedbump when the new site went live.
      - ihid 8y ago
        They're not normalised, no. But the theme holds true. We have about 80% more solutions submitted per day and about 500% more comments per day. So engagement per solution is much higher. It's also worth pointing out that this whole thing is dramatically evolving. It may be that you're a more "expert" developer and doing the more complex problems that means you're effectively lower in the queue (harder to mentor than basic solutions). Things like https://exercism.io/blog/automated-mentoring-support-project https://exercism.io/blog/automated-mentoring-support-project aim to free up our mentors to give them more time to deal with the harder problems. And things like https://github.com/exercism/exercism/issues/4658 https://github.com/exercism/exercism/issues/4658 and https://exercism.io/blog/track-anatomy-project https://exercism.io/blog/track-anatomy-project aim to make mentoring easier and more enjoyable, which means we keep mentors around for longer and they mentor more because it's more fun for them. It may also be that you're on a track that has had 5x or 20x growth (I'm not sure if there are any but you get the idea) in which case the speedbump might have corresponded more to the growth of that track than v2. If you don't mind telling me your exercism handle, I'd be interested to dig into your situation further to understand why you hit that speedbump. It's easy for me to talk in terms of data, but I'm limited to seeing the general patterns rather than hearing real people's stories such as yours, so it's really valuable for me to understand. Feel free to email me (jeremy@exercism.io) if you don't want to disclose it on here :)

ihid 8y ago

> I preferred the semi-OK amateur mentorship over the wildly inconsistent/non-existent mentor assistance. Just to chime in with data here, there is 5x more feedback per day on the new system than there was with the old system. Depending on the track, you'll get feedback in 3hrs to 7days (very occasionally longer), so it is definitely inconsistent in that respect, but you will get feedback. In the old system, you'd get feedback at all in under 10% of submissions. > There was one mentor that I would have happily paid directly to keep giving me feedback, but there was no mechanism in exercism for me to make that offer, even if exercism took a cut. In the future we'll be adding the ability to "pair" mentor/mentees who have both rated the other highly, so this will sort-of happen for you.

codezero 8y ago
How do you define feedback? I got things like kudos etc... and comments which were helpful, I would have considered either one feedback. In general, there seemed to be more interaction, regardless of whether you call it feedback, or social validation. The pair mentor/mentee sounds good, I look forward to it!
- ihid 8y ago
  So there are two modes: 1) Mentored Mode: Submit, get structured feedback from mentors, then publish and get stars (ie upvotes/kudos) and/or public comments. 2) Independent Mode: Submit, publish, get stars (ie upvotes/kudos) and/or public comments. So Independent Mode is very similar to "classic" Exercism. I'm defining "feedback" really as (1) - so there are 5x more comments (from mentors + public) now than there were in old Exercism (public). So for a tangible example: - Feb 1st 2018 (classic): 162 comments, 110 stars - Feb 1st 2019 (new): 831 comments, 46 stars I randomly picked that date, but every date is basically the same sort of ratio. Lots of people say the same as you do that it feels like there's less interaction, but really there's a lot more. I feel like we're failing to make Exercism feel as alive as it actually is for some reason, but I'm not sure why :)
  - codezero 8y ago
    Are these numbers normalized to the number of people making the interactions? or the number of learners? Did you have 5x growth over the past year? Sorry, I am kind of being critical, but mainly because my experienced degraded so much. I trust you to run the place in what ever way you see fit, and any gripe I have is because I really want exercism to work for me. It's the best way I've up-leveled my skills outside of coding on the job, and I really feel like I hit a huge speedbump when the new site went live.
    - ihid 8y ago
      They're not normalised, no. But the theme holds true. We have about 80% more solutions submitted per day and about 500% more comments per day. So engagement per solution is much higher. It's also worth pointing out that this whole thing is dramatically evolving. It may be that you're a more "expert" developer and doing the more complex problems that means you're effectively lower in the queue (harder to mentor than basic solutions). Things like https://exercism.io/blog/automated-mentoring-support-project https://exercism.io/blog/automated-mentoring-support-project aim to free up our mentors to give them more time to deal with the harder problems. And things like https://github.com/exercism/exercism/issues/4658 https://github.com/exercism/exercism/issues/4658 and https://exercism.io/blog/track-anatomy-project https://exercism.io/blog/track-anatomy-project aim to make mentoring easier and more enjoyable, which means we keep mentors around for longer and they mentor more because it's more fun for them. It may also be that you're on a track that has had 5x or 20x growth (I'm not sure if there are any but you get the idea) in which case the speedbump might have corresponded more to the growth of that track than v2. If you don't mind telling me your exercism handle, I'd be interested to dig into your situation further to understand why you hit that speedbump. It's easy for me to talk in terms of data, but I'm limited to seeing the general patterns rather than hearing real people's stories such as yours, so it's really valuable for me to understand. Feel free to email me (jeremy@exercism.io) if you don't want to disclose it on here :)