5 ms·

Looks like NCrunch is now built-in. I happily paid for this extension, which is now redundant. I hope MS paid the developers for their idea!

taspeotis 10y ago
I can't see the video, but if you're referring to continuous testing then yes. http://comealive.io/Code-Connect-Joins-Microsoft/ http://comealive.io/Code-Connect-Joins-Microsoft/
- ygra 10y ago
  NCrunch is a different product, though. It also does continuous testing, but Remco Mulder hasn't been acquired by MS, as far as I know.
  - taspeotis 10y ago
    I know, I said continuous testing not NCrunch.
alkonaut 10y ago
How does it find which tests are relevant? How big can the solutions and test suites be before it starts to...not work? I have a decent sized project (100 projects, 10k+ tests, different suites with longer running smoke tests that take hours and so on). How does it know which tests it can run, and how does it know which will cover a certain line?
- topbanana 10y ago
  I can only speak for NCrunch, but once it's done a full coverage run, it knows which tests are likely to be affected by any changes, so it runs those tests first.
- gokhan 10y ago
  You can automatically re-run affected UI tests after any code change with UI tests recorded in Microsoft Test Manager, since 2012 if I remember correctly. So the technology is already there, I guess it was relatively simple to apply it to unit tests. Test Professional is an interesting product, with recording manual tests, turning them into code, running them as a suite etc. https://www.visualstudio.com/vs/test-professional/ https://www.visualstudio.com/vs/test-professional/
  - topbanana 10y ago
    Sounds fragile as hell. How does it work in practise?
- Metasyntactic 10y ago
  Hi Alkonaut, i'm dev on the Roslyn team, and i work closely with the group working on LiveUnitTesting (LUT). By default LUT just runs all your tests in realtime, as you make edits. It smartly prioritized tests based on seeing what code was previously hit by tests. Now, that said, such an approach would definitely not scale up to projects with huge amount of tests, or tests that take hours and hours to run. As such, LUT provides ways to create 'test sets'. i.e. sets of tests scoped down to just the work you're doing. The intent is to have flexible way to create these sets and the individual sets can be set up to run automatically or manually depending on your preference. A nice things is that all of these test run outside of code VS. So the perf of the tests is far less impactful on VS than it would be otherwise. i.e. you don't have a single GC engine trying to manage all the memory for core VS as well as whatever garbage the tests are generating. With this, and with tests running at lower pri, your editing experience should not be impacted (and we take perf impact very seriously with this feature). Cheers!
  - alkonaut 10y ago
    Great answer, thanks
restlessmedia 10y ago
I thought the same, bit of an NCrunch killer there. Code style looks good - both welcome additions to the IDE.
douche 10y ago
That is always the danger of building a business around filling in holes in other people's products. NCrunch is far from the only continuous testing runner. I've been using the one built into ReSharper lately.
logiclabs 10y ago
It's only available in the Enterprise version, which is well beyond the budget of most. https://www.visualstudio.com/en-us/news/releasenotes/vs2017-relnotes#LiveUnitTesting https://www.visualstudio.com/en-us/news/releasenotes/vs2017-...
- taspeotis 10y ago
  Some Microsoft Partner tiers give you 5-10 MSDN Enterprise subscriptions. I think Gold ISV gives you 25. https://partner.microsoft.com/en-AU/membership/msdn-subscriptions https://partner.microsoft.com/en-AU/membership/msdn-subscrip... The registration fee is something like $2K. There are various competencies you need to demonstrate to become a partner, but there's enough diversity between them that most businesses with Microsoft tech somewhere in the stack could become a partner.
  - douche 10y ago
    If you are an ISV producing code that runs using Microsoft tech on Windows, it is not particularly difficult at all to qualify as at least a Silver-level partner. It's kind of a PITA to run your applications through the verification process every couple of years, but it's not hard, more tedious; or you can get a couple people to pass some of the certification tests.
LyalinDotCom 10y ago
Suggestion, you should also check out this video: Live Unit Testing https://channel9.msdn.com/Events/Connect/2016/171 https://channel9.msdn.com/Events/Connect/2016/171

taspeotis 10y ago

I can't see the video, but if you're referring to continuous testing then yes. http://comealive.io/Code-Connect-Joins-Microsoft/ http://comealive.io/Code-Connect-Joins-Microsoft/

ygra 10y ago
NCrunch is a different product, though. It also does continuous testing, but Remco Mulder hasn't been acquired by MS, as far as I know.
- taspeotis 10y ago
  I know, I said continuous testing not NCrunch.

alkonaut 10y ago

How does it find which tests are relevant? How big can the solutions and test suites be before it starts to...not work? I have a decent sized project (100 projects, 10k+ tests, different suites with longer running smoke tests that take hours and so on). How does it know which tests it can run, and how does it know which will cover a certain line?

topbanana 10y ago
I can only speak for NCrunch, but once it's done a full coverage run, it knows which tests are likely to be affected by any changes, so it runs those tests first.
gokhan 10y ago
You can automatically re-run affected UI tests after any code change with UI tests recorded in Microsoft Test Manager, since 2012 if I remember correctly. So the technology is already there, I guess it was relatively simple to apply it to unit tests. Test Professional is an interesting product, with recording manual tests, turning them into code, running them as a suite etc. https://www.visualstudio.com/vs/test-professional/ https://www.visualstudio.com/vs/test-professional/
- topbanana 10y ago
  Sounds fragile as hell. How does it work in practise?
Metasyntactic 10y ago
Hi Alkonaut, i'm dev on the Roslyn team, and i work closely with the group working on LiveUnitTesting (LUT). By default LUT just runs all your tests in realtime, as you make edits. It smartly prioritized tests based on seeing what code was previously hit by tests. Now, that said, such an approach would definitely not scale up to projects with huge amount of tests, or tests that take hours and hours to run. As such, LUT provides ways to create 'test sets'. i.e. sets of tests scoped down to just the work you're doing. The intent is to have flexible way to create these sets and the individual sets can be set up to run automatically or manually depending on your preference. A nice things is that all of these test run outside of code VS. So the perf of the tests is far less impactful on VS than it would be otherwise. i.e. you don't have a single GC engine trying to manage all the memory for core VS as well as whatever garbage the tests are generating. With this, and with tests running at lower pri, your editing experience should not be impacted (and we take perf impact very seriously with this feature). Cheers!
- alkonaut 10y ago
  Great answer, thanks

restlessmedia 10y ago

I thought the same, bit of an NCrunch killer there. Code style looks good - both welcome additions to the IDE.

douche 10y ago

That is always the danger of building a business around filling in holes in other people's products. NCrunch is far from the only continuous testing runner. I've been using the one built into ReSharper lately.

logiclabs 10y ago

It's only available in the Enterprise version, which is well beyond the budget of most. https://www.visualstudio.com/en-us/news/releasenotes/vs2017-relnotes#LiveUnitTesting https://www.visualstudio.com/en-us/news/releasenotes/vs2017-...

taspeotis 10y ago
Some Microsoft Partner tiers give you 5-10 MSDN Enterprise subscriptions. I think Gold ISV gives you 25. https://partner.microsoft.com/en-AU/membership/msdn-subscriptions https://partner.microsoft.com/en-AU/membership/msdn-subscrip... The registration fee is something like $2K. There are various competencies you need to demonstrate to become a partner, but there's enough diversity between them that most businesses with Microsoft tech somewhere in the stack could become a partner.
- douche 10y ago
  If you are an ISV producing code that runs using Microsoft tech on Windows, it is not particularly difficult at all to qualify as at least a Silver-level partner. It's kind of a PITA to run your applications through the verification process every couple of years, but it's not hard, more tedious; or you can get a couple people to pass some of the certification tests.

LyalinDotCom 10y ago

Suggestion, you should also check out this video: Live Unit Testing https://channel9.msdn.com/Events/Connect/2016/171 https://channel9.msdn.com/Events/Connect/2016/171