3 ms·

Not if there's no transactions over the entire batch process - the system is very likely in an inconsistent state.

by vertex-four 10y ago

pbhjpbhj 10y ago
For companies house, say, my naive view is I'd duplicate the companies record at 6pm. There are about 4 million companies. That at least would allow access to basic company information. I can't imagine 4 million tuples of basic text, with indexes and such, would ever be more than 1G in size? Work on the duplicate and then replace the static version at 6am - I'm sure I've overlooked something, interested to know what.
- vertex-four 10y ago
  Sure, you could duplicate the records and work on them - but these are likely to be old COBOL systems working on fixed-width records where the location of everything is hardcoded and the application is covered in global variables. If you're going to refactor one of these applications, you might as well spend the money migrating away from it (into a language the agency can actually hire for). A possibly more doable approach would be to provide a read-only dump into an external SQL database at the end of every batch job for external systems which desire such a thing, but I'm not convinced there's a whole lot of benefit compared to the cost of doing so. There's no part of the agency which needs the information out of office hours, and it's honestly quite reasonable to say "come back tomorrow" in the few cases where the public might want the information out of office hours - note that the web interface is replacing having to call up the DVLA or visit one of their offices, which would have the same restriction. It'd be much more reasonable to spend money and the time of the people who have experience with the system attempting to migrate off it. Hopefully they're trying.
  - pbhjpbhj 10y ago
    Appreciate your analysis thanks.

3 ms·

Not if there's no transactions over the entire batch process - the system is very likely in an inconsistent state.

by vertex-four 10y ago

Not if there's no transactions over the entire batch process - the system is very likely in an inconsistent state.

pbhjpbhj 10y ago
For companies house, say, my naive view is I'd duplicate the companies record at 6pm. There are about 4 million companies. That at least would allow access to basic company information. I can't imagine 4 million tuples of basic text, with indexes and such, would ever be more than 1G in size? Work on the duplicate and then replace the static version at 6am - I'm sure I've overlooked something, interested to know what.
- vertex-four 10y ago
  Sure, you could duplicate the records and work on them - but these are likely to be old COBOL systems working on fixed-width records where the location of everything is hardcoded and the application is covered in global variables. If you're going to refactor one of these applications, you might as well spend the money migrating away from it (into a language the agency can actually hire for). A possibly more doable approach would be to provide a read-only dump into an external SQL database at the end of every batch job for external systems which desire such a thing, but I'm not convinced there's a whole lot of benefit compared to the cost of doing so. There's no part of the agency which needs the information out of office hours, and it's honestly quite reasonable to say "come back tomorrow" in the few cases where the public might want the information out of office hours - note that the web interface is replacing having to call up the DVLA or visit one of their offices, which would have the same restriction. It'd be much more reasonable to spend money and the time of the people who have experience with the system attempting to migrate off it. Hopefully they're trying.
  - pbhjpbhj 10y ago
    Appreciate your analysis thanks.