10 ms·
Engage with an unemployment algorithm
- hawkeye424 4y agoWonder if the algorithm is based on this http://www.youtube.com/watch?v=YvsKIBSPfWw http://www.youtube.com/watch?v=YvsKIBSPfWw movie ?
- YetAnotherNick 4y agoIt missed the "How good are you at leetcode" question
- hampereddustbin 4y agoInstead of a specific question that most of the working sector is unfamiliar with, the form goes only by the field of study to guess where you're working
- martin_a 4y agoSeems like this joke got over your head. :-)
- deleted 4y ago[deleted]
- filt 4y agoI tried it from my phone. A lot of the times, trying to sexpand the select list moved me to the previous question. After answering all of the questions, I came to a black and empty section, scrolling down from there gave me an option to do the test again.
- kzrdude 4y agoThis all seems a bit backwards but I guess we're just looking at a visualisation of the algorithms. The "forwards" part would be to look at risk factors and how to mitigate or improve those points. Of course together with the unemployment office.
- DocTomoe 4y agoIf you talk to unemployment offices, worldwide, that's pretty easy: accept any job, for any salary. There's always work in the sulphur mines. It's better to try and improve yourself without involvement by biased and agenda-ed state actors. Maybe with a coach. But not with g-men.
- kzrdude 4y agoThe ideas behind Reagan's quote "I'm from the Government and I'm here to help." is the most damaging meme in american politics
- lancebeet 4y agoUnemployment sure doesn't seem to be a big issue for front-end developers in Denmark.
- Izmaki 4y agoAnything that allows you to pocket a starting salary of 36k / month fresh from a B.Sc. does not have a problem with unemployment, lol...
- tokai 4y agoThe job marked for B.Sc.'s is actually quite small in Denmark. Everybody takes a master.
- McBeige 4y agoWould you mind sharing where I can read about this? It's going to be important for my upcoming career choices.
- mrweasel 4y agoI don't have any statistics on this, but when I studied computer science 20 years ago, nobody stopped at the B.Sc. Depending on the university, it's basically only another year, writing one or two papers, and then a year, either doing the same or the equivalent of a minor, where you're just doing the first year of the B.Sc. in some other field. One issue you might encounter is that Danish IT companies are obsessed with hiring people with a masters, even if the job doesn't even require a B.Sc. Most of the jobs in the industry could be fulfilled by people from trade-schools or other shorter educations. Companies just seem to have this idea that they need engineers or people with a masters in computer science, even if their product is just some CRUD application.
- Izmaki 4y agoThings have changed. You can get far with just a bachelors degree, if you are open to working other places than Big Four and corporations with tens of thousands of employees. I have anyway, and I'm only 10 years behind you. If you move into InfoSec the requirements for degrees are even smaller, at the end of the day. Also how much is a masters degree even worth after a handful of years of relevant experience anyway? Not much...
- Olphs 4y agoIs the "algorithm" that simple tree at the end? Really confusing
- hampereddustbin 4y agoMaybe it is to bring about it's simplicity, or a sarcastic tounge-in-cheek jab at it. The word "algorithm" doesen't really distinguish it's complexity in any way. It's just a sequence of steps.
- yobbo 4y agoIt's most likely a trained decision tree with binary output.
- laputan_machine 4y agoTrained in what way? I'd have thought this was just a hard-coded DT, it's multiple-choice questions all the way down
- yobbo 4y agohttps://en.wikipedia.org/wiki/Decision_tree_learning https://en.wikipedia.org/wiki/Decision_tree_learning
- danuker 4y agohttps://en.wikipedia.org/wiki/Decision_tree https://en.wikipedia.org/wiki/Decision_tree
- bryanrasmussen 4y agopart of the reason I posted this is there has been some recent controversy as to whether or not the algorithms used are racist https://www.version2.dk/artikel/styrelse-frikendes-algoritmisk-racediskrimination https://www.version2.dk/artikel/styrelse-frikendes-algoritmi... translated to English https://www-version2-dk.translate.goog/artikel/styrelse-frikendes-algoritmisk-racediskrimination?_x_tr_sl=da&_x_tr_tl=en&_x_tr_hl=en&_x_tr_pto=wapp https://www-version2-dk.translate.goog/artikel/styrelse-frik... on edit: changed where to are, not sure why I wrote where instead of were, but there we go.
- jmeister 4y agoVery interesting. I'm working on visualization and explainability of ML algorithms. Thank you for posting this.
- bryanrasmussen 4y agoI doubt it is a real ML algorithm, there is some discussion of the algorithm in the comments, so it seems the one currently in use is very downgraded from an earlier one that had more variables but not quite sure about that part.
- notahacker 4y agoCertainly it's difficult to imagine someone motivated by accuracy rather than making political points about migrants (and education and desire to work) concluding that what industry people have worked in, the years of experience they have, the level of seniority they've obtained, how much of their previous work is in Denmark, previous salaries they've earned and whether they're willing to take a lower paid job etc are all less important than whether they're non-Western and what their highest level of education is... Admittedly, it's also the type of model you'd expect someone working back from very limited available data to come up with, but I struggle to believe it's a particularly accurate model
- stevesimmons 4y agoThey could well be the few factors that, in aggregate at a population level, give the greatest explanatory power. And which have then been roughly calibrated. The resulting model can be well be accurate in aggregate for informing policy decision tradeoffs. Just totally irrelevant for an individual's particular circumstances...
- timvdalen 4y agoTurns out I'm at high risk of long term unemployment if I were to move to Denmark...
- smcl 4y agoMe too, not sure if I should be worried or if the algorithm is a bit wonky. I am in my mid-30s, graduated with university degree in a STEM field, and have been continuously employed since I left university but filled it out as if I had just quit. The summary after I entered everything showed the following decision tree: How quickly do you believe you will get a job: "Don't know" (I've enough savings to carry me a couple of years, no rush) Origin: "Western immigrant" Verdict: high risk of long-term unemployment. If the little summary is to be believed, there are no other important factors. Changing my "Don't know" to 3 months reduced me to "low risk of long-term unemployment". So if I’m not mistaken, the main factor for their estimate for how long you will be unemployed … is your estimate on how long you’ll be unemployed?
- tokai 4y agoA bit wonky is a very mild way of putting it. Absolutely garbage seems more precise.
- timvdalen 4y agoI think we entered the exact same data!
- mrweasel 4y agoIt might be a case of the algorithm not being designed for your case. If you work in IT, you most likely only have to deal with the unemployment office is you've been hit by stress and is trying to recover. The unemployment office almost exclusively deal with people who are very reluctant to seek employment or have other issues that might prevent them from functioning in the job market (lack of education, mental issues, health issues, language barriers and so on). That does leave them with some funny interactions when someone outside those categories show up. A friend of my took a spent month, after getting hit masters degree in CS, finding the right job. That meant that he need to show up at the unemployment office. They where only able to offer him a forklift certification, which he didn't need or want. In the end they just left him alone for a month and he found the job he wanted. Overall the Danish unemployment office is remarkably bad at finding jobs for people or even help them get better qualifications. There's an entire book written about it (based on one journalists experiences). In the book the only person, that particular office found a job for is one they hired themself.
- m00dy 4y agoI think Banks should also expose the internals of their credit rating algorithms. Openness and transparency should be part of new world order.
- hampereddustbin 4y agoThey might be afraid their algorithms would be too easy to manipulate if you knew all of it's factors. Since testing the all of the possible factors would be cost-prohibitive for most, it's not exactly 1:1 with software development
- justinclift 4y ago> They might be afraid ... It's not really relevant what they're afraid of. They should be made to be transparent, and it should be enforced when they don't meet the mark.
- hampereddustbin 4y agoMaybe I used the wrong wording. There may be legitimate reasons for keeping it vague, because designing tamperproof public metrics for credit approval has huge risks involved, or they may be designed so conservatively that a lot actually qualifying people would now be unable to get a loan. I've personally been bitten by the latter despite making nearly six figures. Similarily I've not really seen any sites which publish how their anti-spam filters work or what the treshold values are either for similar reasons. They're possible to figure out, but cost a lot more. Maybe a better solution would be to somehow guarantee that they're consistent with their own rules, and regularly audited so that they're also compliant with the current law?
- justinclift 4y ago> designing tamperproof public metrics for credit approval has huge risks involved The worst scenario that seems to fall out of this is "evolving arms race between bad actors and the metrics". To me, that doesn't seem anywhere near as bad as the (current) lack of transparency.
- GistNoesis 4y agoIs this the real life or is it just fantasy ? How far is this demo from the real algorithm ? In the demo it seems they use a very simple decision tree just based on very few criterion (In order : Self-perceived ability to get a job, Origin, Age, Recent employment rate). Does this simplistic (racist and ageist) model have been derived from real data and is in use, or is it just some kind of propaganda (from CopenHagen University?) and the real model they use is much more complex. Random forests can be made much bigger and match data quite well provided they are big enough, but the bigger they get the harder they are to explain. Caught in a landslide, no escape from reality.
- nonrandomstring 4y agoThe general problem with all this "algorithmic" (lazy-arse avoidant) jiggery-pokery is that it entrenches a bunch of extant values. An "expert system" - what this is - is nothing but the sum of historical expertise minus the human wisdom lost encoding it. Thunderbolt and lightning very, very frightening.
- PeterStuer 4y agoIt seems to be the result of analyzing 152.000 unemployment case histories. While the outcome is rather coarse grained I have a feeling it wouldn't be too far of reality for a quick risk assessment. You can say e.g. the resulting model surfaces 'ageist' rules, but isn't that just a reflection of reality? Jobs chances for the average >56,5yo are indeed pretty slim, and not just in Denmark. Should the model lie about that?
- jmeister 4y agoIs it racist or ageist if it is accurate?
- Aeolun 4y agoThis website is quite terrible on mobile. I don’t know how many times we’ll have to tell people to stop hijacking the scroll position, but I suspect until the end of time… Also, none of my questions mattered, by virtue of being a western immigrant and expecting to look for a job from 3-6 months I’m somehow at risk of long term unemployment.
- hampereddustbin 4y agoIt would be really great if any javascript binding could be turned off in about:config or it's equivalent in other browsers. It's not really a solution, but would bandaid a lot of bad design which I can't see any legitimate use for (like scroll-hijacking). I guess you can already overwrite any existing function with your custom non-function with userscripts, but that seems quite hacky and non-portable, since most mobile browsers don't really support extensions (Firefox does, but only a small subsection)
- dry_soup 4y agoIt's pretty terrible on a desktop browser as well
- hahamrfunnyguy 4y agoIt's quite terrible on desktop too.
- marcinzm 4y ago>Also, none of my questions mattered, by virtue of being a western immigrant and expecting to look for a job from 3-6 months I’m somehow at risk of long term unemployment. I wonder if the underlying cause is "having savings and not needing a job to have a comfortable living." May also tie into how easily or not you can get government support. The more desperate you are the more likely you'll settle for any job as quickly as possible.
- martin_a 4y agoYeah, I got the same result, too. Really wonder if this algorithm is good for anything. I tried to play "Give me a break, then I'll look for a job and I am certain I'll find something" and it just tells me I've got a high risk for long term unemployment... Ok, whatever.
- tgsovlerkhgsel 4y agoBased on the visualization the algorithm seems to be: If you input that you expect to be unemployed for a short/long time, it returns that assumption. Only if you say you don't know... Immigrant/descendant: High risk of long term unemployment, right away. (Edit: Apparently except non-western immigrants, based on the source code!) Age is the next check that can classify you as high risk, I didn't look for the threshold (Edit: 56, according to the source). As long as you're below that, the deciding factor is... How long were you employed out of the past 36 months? 12 months is apparently good. (Edit: <2 is the threshold). It seems like most of the questions don't seem to be considered (if the visualization is to be believed) and it's a very simple "if x return foo" style algorithm, not some fancy scorer/ML. Look for function setValues() in https://ledighedsalgoritmen.dk/p5vis.js https://ledighedsalgoritmen.dk/p5vis.js
- notahacker 4y ago> Immigrant/descendant: High risk of long term unemployment, right away. (Edit: Apparently except non-western immigrants, based on the source code!) The latter part is probably on the basis that non-Western immigrants mostly needed skilled worker visas, whereas descendents and 'Westerners' (which apparently maps to "EU members" in this case) don't. Though as with most of the rest of it I'd struggle to see this as a conclusion from advanced modelling and not just a stereotype kept relevant largely by not asking the descendent or 'Westerner' what type of work they'd been doing and how long they'd worked in Denmark
- hash07e 4y ago[dead]
- bildung 4y agoGermany is a bit special here because refugees often are not allowed to work at all, or, depending on their status, are only allowed to work under certain conditions. This was introduced by the conservative parties as a juridical answer to fears of immigrants "stealing" jobs.
- larsnystrom 4y agoOne of the named authors in the footer also wrote an article about the STAR algorithm, which I think might provide some more context: https://www.zetland.dk/historie/sOMVZ7qG-m8aLzmJK-94d1e https://www.zetland.dk/historie/sOMVZ7qG-m8aLzmJK-94d1e
- Dave3of5 4y agoI'm also high risk of unemployment if I ever moved to Denmark. Oh well ...
- londons_explore 4y agoSoooo.... What is the use of the output of this algorithm? If it's for the government to predict how many 'help finding employment' leaflets the government should print next month, that seems fine. If it's to decide who is eligible for state handouts, it is unsuitable.
- deleted 4y ago[deleted]
- arghwhat 4y agoDane here. I know nothing about this particular "algorithm" or how it is used, other than that it was to my knowledge meant for use in job centers - i.e. it applies to someone who is already unemployed and unable to find work on their own for whatever reason (we should not judge, every life is different). In some cases, those on social benefits are also forced to job centers despite their condition, which might negatively affect this crude "algorithm" as well. In other words, it does not represent the job market or life in Denmark as a whole. With a 2.5% unemployment rate that should be more or less obvious. Of course our job market has a degree of ageism, sexism and racism (with the rather racist nationalist parties being popular in some regions), unfortunate as it may be. A male, white Dane in their 20s is likely going to have an easier time getting jobs than a female foreigner in their early 30s, where the language barrier, additional paperwork for work visa and non-zero risk of maternity leave (can easily be 50 weeks, which is costly in industries where the standard is full rather than partial salary) may make a small company uncomfortable. But while I cannot speak for industries I have never worked in, industries that we are familiar with here on HN are fully internationalized and would hire a foreigner in the blink of an eye, and such a person would is unlikely to ever discover a job centers. TL;DR: don't worry about this crappy "algorithm".
- mrweasel 4y ago> industries that we are familiar with here on HN are fully internationalized and would hire a foreigner in the blink of an eye Small correction: Foreigners from within the EU. Many of the Danish software companies have contracts with e.g. banks and government organisations, that makes them nervous about taking in people from outside the EU. It depends very much on the company. It should be easy enough to find someone willing to hire you, but many won't.
- arghwhat 4y ago> Many of the Danish software companies have contracts with e.g. banks and government organisations, that makes them nervous about taking in people from outside the EU. I actually meant outside EU. I do not know of any places that would exclude foreigners due to government contracts. I see no lack of foreign hires within fintech and medical, and the usual government contract dumpsters (KMD, Netcompany, that sort) also hire foreigners. I myself work in a place that employs a lot of engineers from India on-site for example, and I know many companies like it. Foreigners from within EU will have easier paperwork and living situation though.
- recoveringeng 4y agoDane here. Disclaimer: I can't say I really know much about this, but here is a bit of background info: STAR is acronym for Styrelsen for Arbejdsmarked og Rekrutering (English: Agency for Labor Market and Recruitment). They have a note describing the system (in Danish) at [1]. I copy/pasted a few relevant sections to Google Translate at [2]. TL;DR: Algorithm is a decision tree based on questionnaires and outcomes of about 152000 cases. The note states a precision of 70% and a recall of 32%. There is no mention of a split between modelling and test data. [1] https://star.dk/media/12514/2020_01_31_beskrivelse_-_profilafklaringsvaerktoej_til_dagpengemodtagere.pdf https://star.dk/media/12514/2020_01_31_beskrivelse_-_profila... [2] https://translate.google.com/?sl=da&tl=en&text=Modellen%0APrincippet%20bag%20den%20statistiske%20profilafklaring%20er%2C%20at%20man%20ved%20at%20se%20på%20tidligere%20ledig%C2%AD%20hedsforløb%20kan%20få%20en%20ide%20om%2C%20hvem%20i%20en%20gruppe%20af%20nyledige%20dagpengemodtagere%2C%20der%20er%20i%20risiko%20for%20at%20blive%20langtidsledig.%20Den%20statistiske%20vurdering%20i%20profilafklarings%C2%AD%20værktøjet%20forsøger%20således%20at%20forudsige%20om%20den%20enkelte%20borger%20vil%20være%20ledig%20i%20mere%20end%206%20måneder.%20Dette%20gøres%20ved%20at%20sammenligne%20borgeren%20med%20andre%20nyledige%20dag%C2%AD%20pengemodtagere%2C%20der%20historisk%20set%20er%20blevet%20langtidsledige.%20Maskinlæringsalgorit%C2%AD%20men%20danner%20på%20denne%20baggrund%20kombinationer%20af%20faktorer%20der%2C%20i%20gennemsnit%2C%20bedst%20forudser%20om%20borgeren%20kan%20forventes%20at%20blive%20langtidsledig.%0A%0AMere%20præcist%20består%20modellen%20af%20et%20statistisk%20genereret%20beslutningstræ.%20Beslutnings%C2%AD%20træsalgoritmen%20kategoriserer%20i%20én%20af%20to%20grupper%3A%20risiko%20og%20ikke-risiko%20for%20langtidsle%C2%AD%20dighed.%20Algoritmen%20er%20dermed%20trænet%2C%20på%20data%2C%20til%20at%20identificere%20de%20faktorer%2C%20der%20er%20de%20vigtigste%20for%20at%20forudsige%20langtidsledighed.%20Kategoriseringen%20starter%20med%20den%20faktor%20der%20minimerer%20usikkerheden%20ved%20forudsigelsen%20mest.%20I%20kombination%20med%20denne%20faktor%20vælges%20så%20den%20næste%20faktor%2C%20på%20en%20måde%20hvor%20de%20to%20tilsammen%20minime%C2%AD%20rer%20usikkerheden%20mest%2C%20og%20så%20fremdeles.%20Faktorer%20og%20kombinationer%20af%20faktorer%2C%20som%20ikke%20væsentligt%20bidrager%20til%20at%20mindske%20usikkerheden%2C%20medtages%20ikke.%20Algoritmen%20fører%20til%20”grene”%20på%20beslutningstræet.%0A%0AData%0ADen%20statistiske%20profilafklaring%20er%20baseret%20på%20en%20analyse%20af%20påbegyndte%20dagpengefor%C2%AD%20løb%20i%20perioden%20maj%202016%20til%20juni%202018%2C%20hvor%20borgeren%20samtidig%20har%20udfyldt%20forbere%C2%AD%20delsesskemaet%20i%20forbindelse%20med%20forløbets%20start%20(ca.%20152.000%20forløb).%20Data%20består%20af%20udvalgte%20registerdata%20og%20besvarelserne%20på%20forberedelsesskemaet.%20Registerdata%20og%20spørgsmål%20i%20forberedelsesskema%20er%20udvalgt%20med%20udgangspunkt%20i%20den%20eksisterende%20viden%20om%20de%20mekanismer%2C%20der%20har%20betydning%20for%20ledighed.&op=translate https://translate.google.com/?sl=da&tl=en&text=Modellen%0APr...
- qwerty456127 4y agoJust a fun fact: ~90% people outside academia I ever knew had jobs unrelated to their formal education so the questions about education level and field always seemed pointless to me.
- BlargMcLarg 4y agoMost questions are pointless and have almost no evidence behind them. Doesn't stop hiring from believing they know better.
- qwerty456127 4y agoWhy isn't anybody trying to fix the system so it would be more efficient at directing people to the jobs they would be actually good and happy at? To me it seems this (using the human resources the optimal way) becomes more and more important nowadays. And I believe the formal education one has completed can only serve as a hint to what the best job for him is and not a direct definition of that.