4 ms·
"The reason this stopped, people retired." Sorry to hear that. I'm short on suggestions for that one given I focus on getting tools adopted more than re-adopte
by nickpsecurity 10y ago
"The reason this stopped, people retired."
Sorry to hear that. I'm short on suggestions for that one given I focus on getting tools adopted more than re-adopted. I'll have to look into that scenario a bit given I bet it plays out a lot.
"I've read a number of your posts, usually when I see your handle I make a point to read them regardless of how long they are. And sometimes I realize it's you just by the content and look for more in a thread. In principle I think we're on the same page"
Appreciate the kind words. I work hard to get the quality stuff out there to people like you. Hard to assess how it's being received. Comments like that and occasional emails are what I go on for impact assessment.
"A test case may involve dozens or hundreds of key messages to simulate a "conversation" between two or more radios to determine how our software behaves, with thousands more sent automatically. "
Ohhhh. Ok. I'm already seeing it based on prior experience testing both protocols and UI's. Yeah, that would take a lot of testing if specs were out of date or insufficient. With specs, you could use design-by-contract on it to support testing with interface checks and/or auto-generate tests depending on tooling. I mean, the Fortran static analysis tooling might be behind a bit... (read: nonexistent).
"but never finished, going through all the messages that could be sent and what the responses ought to be and when to try to produce a better simulator than we presently use"
Are you actually able to change the protocol in arbitrary ways so long as product functions properly in some other black box your company can control? Or do you have to maintain its existing, functional behavior for backward compatibility? If the former, you can gradually spec it out then maybe apply a protocol generator. If the latter, it might stay pretty manual with DbC, testing, and/or static analysis being best you're going to do.
"In a past life I worked with LDRA "
Oh, you got to work with one of the real ones. Good for you. I haven't been able to afford them so I keep trying to get comments on how effective or usable they are. Did it catch stuff well? Make it fairly easy to do requirements/spec/code consistency or lots of redundancy for user? On the latter, point is that high-assurance development requires a number of documents that all describe the same thing. Essentially views on the operation of the system. How easily a tool can keep them together and/or propagate changes in one to another is important to avoid people saying "screw it: i'll update that later [never]." So, I'm curious about its usability. Still no consensus on tools for that with Topcased being an open one some went with, some using traditional SCM w/ specs/docs in it, some HTML (eg LISP spec), and Karger et al on Caernarvon used Framemaker with lots of cross-links.
"we used Telelogic DOORS"
Could've been interesting but IBM acquired it for Rational suite. Nevermind.
"wanted to use SPARK Ada but found the documentation at the time to be sparse online"
Might be worth re-exploring given they've done a lot over the years. SPARK 2014 was quite an update. Almost nobody does anything with it but there is a DNS server written in it. Might contain insight on applying SPARK to protocol design/verification. Not to mention its other, potential benefits. :)
http://ironsides.martincarlisle.com/ http://ironsides.martincarlisle.com/
- Jtsummers 10y agoLDRA: It's been a bit since I touched it. Checking their site, we were using LDRA Testbed, our use was for DO-178B certification. I specifically was using it to develop test cases. What my memory is telling me is that we were using it to test pre and post conditions, a lot like you'd use in design by contract, on functional units of our system. I was a tester, not a developer, I didn't use its static analysis tools as much and so I don't recall much more. DOORS: Honestly, at this point I don't care who makes it as long as it works. What's needed, and what DOORS at the time provided, is: Concurrent editing. Traceability from one document to another. Workflow control - I can make changes, but someone else has to verify/validate. Same as with any issue tracker. Revision control Everything but the workflow control I can do with a simple markup language, git, and a few scripts. But in industry it seems people prefer Word documents and Excel spreadsheets. SPARK 2014: I will, if I ever have downtime. I leave for the office at 7, go to the gym until 8, then spend the evening with friends or my girlfriend. Weekends are my only downtime these days and I'm finding myself lacking motivation to do this. I need a project to work on, trying that now. We don't have control of the protocol as there are others making products that interact with ours (in theory, in practice it's hit-or-miss as some are more faithful to the spec than others). One of the things, as an example, that I want to discover by go over the protocol specification are cases like this: I can't recall the specifics, but there was a mathematically impossible requirement. It was related to the discrete logarithm. Only some of the values involved weren't relatively prime wrt the modulus. So what happened, no one implemented that part of the specification. No one tested it either because there wasn't a good traceability matrix revealing that it was untested. One day, someone realized this, implemented a test to see if this part of the spec was being done, and hey, the test failed. This reveals major flaws in the process. 1) That specification feature should never have made it into the final. 2) The test should have been made or in-progress once that spec feature was introduced, which would've led to (1) being true. Speaking of gym, it's time for me to go. Thanks for the pointer with Ironsides. I'll take a look at it and SPARK 2014 over the next few weeks. We're about to wrap up my current project (well, in 3-4 more months) so now's a good time to start putting together a demo to try and save the next project from some of the current issues.