5 ms·
This book is comparatively old, but the authors are experts, and likely the material is still surprisingly current. But I will insert another point, call it th
by graycat 10y ago
This book is comparatively old, but the authors are experts, and likely the material is still surprisingly current.
But I will insert another point, call it the "Dirty Little Secrets of Optimization Your Books and Professors Don't Tell You."
Here is a bottom line, bold, summary fact of life about such optimization, mathematical programming, operations research: It's super tough to find real world problems where can apply such material, do well on the problems, please the customers, and get paid well enough to have a career. Trying such work either as a consultant or an employee is tough.
There are exceptions, but they are rare. If you can find an exception, terrific, but, did I mention, they are rare. Nearly anything else you can do with a BS, MS, or Ph.D. in a STEM field will be an easier way to make a living.
In practice, the field has a bad reputation: Early on there was a lot of hype and a lot of projects that failed. Leading reasons for project failure were (1) the basic data was too difficult to collect, (2) some custom software was needed, and it was too difficult to write, (3) the available optimization software was not powerful enough, (4) the mathematical techniques were not powerful enough, at least not without a lot of special work unique to the particular practical problem, (5) the computer run times were too long, too often days or weeks.
In addition there were various social problems: So, the optimization people were seen as wizards with tall, conical black hats decorated with stars and moons and were not really welcome, were not understood, were threatening, etc.
Here is a larger problem: The optimization people did not have a recognized profession. Lawyers, physicians, insurance actuaries, and more do have a recognized profession, maybe with government licensing, a code of ethics, professional peer review, legal liability, graduate education which is not just academic but also professional, likely with practical apprenticeship, a serious professional society, professional certification, etc. That way, a generalist line manager can hire a respected professional, as an employee or consultant, with relatively low risk to his career. Without professional status, such a line manager is reluctant and for good reason.
Then there's another secret: Early on, when there was a lot of optimism, there were two ideas, maybe just implicit but, still, powerful:
The first idea was that such optimization would, to borrow a more recent phrase, "eat the world". That is, essentially every economic activity in the world would be directed by such optimization.
The second idea was that the optimal solution was the absolute goal. Accepting a solution that was 10 cents away from optimal was seen as a moral lapse. The word optimal was a stick used to beat up on everything and everyone else.
Then reality set in: The applied math available was nowhere nearly powerful enough to solve just any practical problems that could be found in routine operations. And that was just the clouds before the hurricane:
The hurricane happened when the question P versus NP was formulated and, then, it was seen that large, practical problems in NP-complete were
as common as pebbles in a stream bed. Darned near every problem in scheduling, routing, logistics, resource allocation, and more could want at least something as difficult as integer linear programming, but that problem is in NP-complete. Then considering non-linear aspects gave a storm that made a hurricane look like a gentle rain. Then it got worse: A lot of real problems had a lot of randomness. Okay, a lot of those problems can be formulated as stochastic optimal control problems, maybe continuous time, maybe discrete time, but then get bad news right away: First don't have enough data on either the system dynamics or the probability distributions of the random effects. Second on realistic problems, stochastic optimal control can eat super computer time by the months per problem.
The worst of the chuckholes in the road was the struggle of P versus NP. And with the moral attitude that optimal was to be obtained made the P versus NP challenge much worse. Indeed the US economy went for decades declining to implement solutions that could save 15% of operating costs because saving 16% for an optimal solution was too difficult for the math and the computing. That is, commonly saving that last 10 cents is by far the hardest. Or there might be millions of dollars to be saved, but still could not save the last 10 cents, and people gave up due to the difficulty of that last 10 cents.
And there was a huge cultural problem: Various universities set up professorships, sometimes departments, concentrating on optimization. Well, there the professors concentrated on publishing papers and largely ignored real problems. And anything like professional education was pushed out as inferior to the research agenda. Then, sure, the students got relatively little benefit in non-academic careers -- e.g., they were not in a profession.
For a while, there was an eager customer who did put up with a lot of the hype and poor or failed projects -- the US DoD.
So, bottom line: A lot of very good applied math has been done for optimization. And there is a lot of high quality software. But real problems that can be attacked successfully with these tools and where the benefits are really worth the botheration, time, money, and effort are rare.
If you can find suitable real problems and make a living, you will be very rare, but good for you.
What will likely happen is that occasionally some optimization will become part of some software that is sold as, say, SaaS. And, in some fields where optimization is known to be effective, say, feed mixing, we can expect that optimization is an accepted tool in that field.
So, what was the biggest result of the academic research? Sure, they identified the problem of P versus NP. Gads, I should have started a pizza shop!
- jpfr 10y agoThere are many many successful applications. Yes, production scheduling has proven to be "resistant" towards mathematical optimization. But many other engineering disciplines rely on it heavily. Take for example model predictive control aka receding horizon control. Control people have always built formal models of their systems. And now they use optimization theory where the systems don't fit the old linear quadratic controller paradigm very well. You drive a car with traction control? Chances are that some embedded system is solving an optimization problem at kilohertz speed so you stay safe when turning on the road.
- shoo 10y agoi was thinking vaguely that the successful applications might be more likely to pop up in scenarios where problems can be clearly defined and are unlikely to change. i've worked on optimisation projects in business contexts where the requirements and the problems tend to change somewhat from month to month - this doesn't make for relaxing / hugely successful projects if the requirements changes bend the problem into territory that breaks the effectiveness of the solution approach.
- graycat 10y agoYup. In the real world, it tends to change. Then it can be tough for the computing, with or without optimization, to keep up. Yup.
- Tarrosion 10y agoFor what it's worth, my experience thus far has been quite different: - I agree that operations research has a brand problem, but the problem is that nobody recognizes the name. Every week I have this conversation: "What do you do?" "I'm a PhD student in operations research at MIT." [blank look] "Have you heard of OR? I wouldn't blame you; most people haven't." "No, what is it?" "It's something of a mix between computer science, applied math, and statistics, and in particular we do a lot of optimization work." "Wow, that's really useful!" So no, we don't have the brand of computer science, but I get a uniformly positive reception when I describe what I do. From technical people there's a fair amount of "Oh! I have this optimization problem in my work, do you think..." - People graduating from MIT operations research seem to have 100% success in finding good jobs, both in academia and industry. I think we'll be surprised to learn that finding good jobs is tough. Yes, we all benefit tremendously from the name MIT, no doubt. Nonetheless, if everyone graduating from my program has an excellent offer lined up by the time they cross the stage...that doesn't suggest a congested market with few opportunities. - Yes, integer programming is Hard in the technical sense. However, with overwhelmingly high probability, the problem you actually care about is not hard at all. Write down the first formulation that comes to mind, throw it at Gurobi or CPLEX, go for a coffee, and when you come back you'll have an answer with tiny optimality gap, perhaps certifiably optimal. Integer programming in particular is one of the great academic success stories; the combined speedup of hardware and algorithms in the last ~30 years has made IP solvers ~10e9 faster. ___ You write as someone who has personal experience and knows what they're talking about, so perhaps I should update my priors. But suffice to say I think OR and its practitioners are in a fantastic spot right now.