6 ms·
> As a teacher, I can tell you that students get really angry if you put a question on an exam that requires a concept not explicitly covered in class. Of cours
by vlovich123 6mo ago
> As a teacher, I can tell you that students get really angry if you put a question on an exam that requires a concept not explicitly covered in class. Of course, if you work as an engineer and you’re stuck on a problem and you tell your boss it cannot be solved with the ideas you learned in college… you’re going to look like a fool.
Very flawed comparison. At work I get to go off and do research, experiments, can collaborate with peers and people who might have more expertise in a given sub problem, and generally have much more time. An exam trying to test you on material you haven’t studied is supposed to test for what? Your ability to synthesize knowledge out of thin air.
The rest of the article is well written and correct, but this particular aside felt weird.
- andai 6mo agoI think it depends on the question. If it's not a question of the form explicitly presented before, but answerable with a minute of thinking using the knowledge the student has already mastered, then it makes sense. A time limited exam is probably the wrong place for that, though, due to the stress interfering with that kind of thinking. It would be better for a homework assignment. If ChatGPT didn't exist. Okay, maybe in class, on paper is the right place for that.
- sdenton4 6mo agoThe while premise of "learn some stuff them take an exam on exactly that stuff" is pretty flawed, and that's the point. So much of the academic structure is about what's convenient for evaluation, rather than what's best for learning. Why not get rid of the exam and replace it with something else entirely? Who says we have to have exams at all?
- noworriesnate 6mo ago> So much of the academic structure is about what's convenient for evaluation, rather than what's best for learning Academia is going to have to focus on the latter anyway because we have AI, which is exactly the same: it’s only useful when you can evaluate the output for accuracy independently. But how do you do this without throwing out objectivity entirely? Maybe we need to move to apprenticeships?
- deleted 6mo ago[deleted]
- dosisking 6mo agoFrom my experience, the boss is usually a complete moron, so who cares. It also creates this unhealthy assumption that the engineer is subservient to the boss.
- bryanrasmussen 6mo agoFrom my experience the boss does not know things you know, that does not make them a complete moron because they probably know things you don't. Here's an example, consulting at a large Danish company, every Friday morning all departments in this big building would share breakfast and the bosses would say some things. So this one morning they explained that in the coming months people should register time in a particular way because of accounting and how it related to a particular government grant and money that needed to be used up by a particular time in order to get to the next step of blah blah blah. I realized as my eyes glazed over, damn this is just the same reaction people who don't understand browser rendering engines get when I start telling them about different events. I also noticed other clueless people gamely trying to question these finance nerds on how things worked, and the patient finance nerds explaining some detailed bit and the clueless person clearly out of their depth with that "uuuuhhhh, hope they don't ask me if I understand" look on their face. Now, if it hadn't been for them explaining this stuff I would have gone around thinking the boss is a complete moron. I once saw him mistake a nail gun for a drill! He doesn't understand how search engines work and why stemming and decompounding might be important, I know because I tried to explain to the idiot one time!! But since he actually talked about his work for a bit I realized he just happens to know stuff I don't. I'm betting most of the morons you know are maybe not quite so stupid, although probably not as forthcoming as why things need to be done in a certain way to those who work under them.
- dijksterhuis 6mo agoyeah. someone, somewhere, at some point, will think i’m a clueless idiot. we’re all clueless idiots at the end of the day.
- airstrike 6mo agothat's a great story and a remarkable level of self-awareness. thank you for sharing
- from_memory 6mo agoI feel like it's an argument for the benefits of abstract reasoning. I don't think they are saying it'll be like that in the real world, I think they just want to test how you do under adverse conditions. Stress testing the student's academic prowess, if you will.
- noduerme 6mo ago>> Your ability to synthesize knowledge out of thin air As someone who graduated high school, I'd hope my more accomplished peers would know the difference between hypothesis, theory and proof. It is entirely possible, and useful, to test someone's ability to form a cogent hypothesis. If you were faced with a question beyond the scope of the ideas you were taught, and could not rely on any assistance, the only useful thing to know about you is how well you would handle it yourself. If you would synthesize knowledge out of thin air, that would be a failing grade.
- ordu 6mo ago> If you were faced with a question beyond the scope of the ideas you were taught Who knows the scope of the ideas I was taught? I mean, I could use derivatives and sometimes to integrate in 8th grade, should I get a failing grade if I used them in a test? I see the point of your post, it is important to distinguish between what you know, and what you don't know, but maybe suspect. School tasks are built in a way, that the very form of the task can be used to make good guesses that may help you to solve the tasks. It doesn't work in reality, but it works in school. But the solution is to add questions without answers, not questions with answers beyond someone's knowledge. Like "what was Mozart's opinion on pineapple pizza?" or "what size was Julius Caesar?". Well, tests needs less obviously unanswerable questions than these, but you got the drift. Edit: Thought it will be tricky with math. For example: "Alice has 3 apples, and Bob has 2. How many oranges they have?". School math problems have a convention, which means that if oranges where not mentioned, then they have 0 oranges. Compare with "Alice has 3 apples and Bob has 2 oranges". If the problem doesn't mention Alice's oranges, then Alice has 0 oranges. It is implied and these implicit rules are the first difficulty kids face when starting with math.
- jrowen 6mo agoI found the whole article to be a bit heavy on anti-academia. And I went to industry after undergrad. It's a false dichotomy between the "thinkism" bogeyman (actually reading books and papers and putting work into theoretical design is just bad now? Have they tried building anything in the physical world? Checked in with nuclear physics, ever?) and hands-on experience. Both are important. It should be about balance, not trashing an incredibly valuable set of tools because others exist...
- mettamage 6mo agoI am team academia more than hands-on experience. And I have 5 years of experience. To me, it felt like most SWE things could eventually be solved by what I learned at school. Not everything I did I learned at school, such as navigating codebases with more than a million lines of code. But most things? Yea. With that said, I am curious how people say that they learned much more through experience, what did you specifically learn?
- bsrhng 6mo agoI find that many people can learn a lot by doing but then at some point hit a wall and really struggle to recognize that another kind of learning needs to take place to understand a deeper concept.
- ttoinou 6mo agoCould you tell us what you learned at school that is useful for your SWE career? Im sure there is a lot of us that learned 0 at school and learned everything ourselves as kids on the internet
- vladms 6mo agoThe problem with "learned everything ourselves" is that you might have niche interests and you miss things. Things I learned that probably I wouldn't have by done by myself: computer architecture (memory, buses, cpu-s, instruction set), and related VHDL/Verilog; how complex is synchronization (implementing from scratch synchronization libraries); different programming paradigms (functional languages); compilers & operating systems (kernel modules, etc.); various types of maths (dsp); algorithm complexity analysis. Some I ended up using more during my career than others, but knowing more definitely reduced my tendency to think "ah, that should be easy".
- zipy124 6mo agoI agree that it's a flawed comparison but it does touch on a very real issue in the workplace. The difference between employees who I can send away on a problem and they'll encounter issues and try to solve them, vs those who come back to the senior at any problem, presents a serious ceiling on the level those employees can work at.
- lazyasciiart 6mo agoPerhaps the example should be a homework assignment, not an exam.
- lukan 6mo agoEven then I would call it bad teaching, as the usual mode is: New stuff gets explained in class by the teacher - the details are for self study. This is how it was communicated to me in school, so I would call it part of the "contract". But giving a homework on a fundamental new subject without explicitely telling that this is what it is about, will rightfully confuse, as the normal mode is different. And when it happened to me, it always happened because the teacher messed up and got confused themself what they had and have not teached before. Teaching to self study is a valuable skill in itself that should not be taught by accident, but with a clear pedagogic concept.
- kaashif 6mo agoAs a leader, I can just tell people literally that: if you can't go away and work independently on a problem, it puts a ceiling on how well you're going to do. Then I ask people what they've tried before asking me. Just being upfront with people can break low performance patterns of behavior.
- rukuu001 6mo agoI think it’s largely there to set up the point that comes after, which is that it would be absurd in a professional setting to pronounce a problem unsolvable because the entirety of your university education doesn’t provide enough information to solve the problem.
- Eddy_Viscosity2 6mo agoI took an exam once and there was a question on it that wasn't covered. I had vaguely remembered something from somewhere else and was able to piece together the formula and actually got the correct answer. When the test marks came back, the prof apologized about the question and didn't count it in the grades. Myself and two other people in the class who got the answer were held after class and accused of cheating. That is the school system. They do not reward creativity or ingenuity.
- Kheyas 6mo agoSounds like the synthesis problem could be the difference between a 8-9/10 and a 10/10 score. It would work in an accuracy grading system instead of a hedge against stupidity system.
- irishcoffee 6mo agoI grew up poor. I thought my ticket to not being poor was an education. By the time I was applying for colleges (I had good grades) I realized that the education system was a joke. I got through college, a very well-regarded engineering program, putting in the bare minimum effort to graduate. I make a lot of money now, 20 years later. I attribute none of my success to public education or college, I didn’t learn anything besides our education system (in the US) is not what they tell kids it is growing up. We beat the drum of education because it seems like a nice simple solution to fix a lot of perceived problems. “Oh you mean if we just throw money at this problem it’ll fix it?!” Baltimore city gets some of the highest per-student federal funding in the country. My daughter is in a public middle school there, living with her mom. I’m in the burbs with my wife and kids. She told me just yesterday she wants to go to high school in my district because “well it just seems more normal than city schools” She also thought California was a country up until yesterday. Straight A student. At some point, probably too late, we’ll realize we did it a wrong. Floating kids through high school, dropping an anvil of debt around their neck for a college degree they won’t use. Met a fellow the other day, he has his masters in social work. Making very, very good money, as a regional manager of a car sales group, I forget the specifics. Said he never used his degree and he is very grateful he has a clear path to pay the debt off. I don’t know what the fix is, but I’ve seen enough to know what we do now, ain’t it.
- kakacik 6mo agoNope, and nope. I've had tons of such questions during university in various courses, so what? Are they supposed to to babysit you and handle you only exact stuff they went over and over, to not upset some fragile minds? Such stuff is part of educational life. They expected to synthesize the knowledge out of other, related knowledge that was very directly covered, and use a bit of if-this-then-that. All in trivial manner if you actually grokked the subject well enough. I failed some, did well on others, felt a bit of unfairness emotions completely understandable for that young mind which just wanted to do the test and move on. But when looking back, they were good questions, testing my actual skills in topic I was studying.
- jb3689 6mo agoYou have a deadline and scope (of solution) handed to you from product/management. It’s the same issue now at work.
- collabs 6mo agoAbsolutely. I did this just last week. I couldn't figure out why I wasn't able to get out application to use a fileserver in a new test environment. I brought it to the team and got help from someone else. > As a teacher, I can tell you that students get really angry if you put a question on an exam that requires a concept not explicitly covered in class. Of course, if you work as an engineer and you’re stuck on a problem and you tell your boss it cannot be solved with the ideas you learned in college… you’re going to look like a fool. I really hope this kind of thinking dies away because the longer you wait the more money you waste, not just your own salary but the opportunity cost of time. And this person is a teacher?
- weinzierl 6mo agoMaybe the impression cones from a different understanding what "concept not explicitly covered in class" means. Of course you would not test a completely unrelated concept but where I grew up "Transfer of Learning" is supposed to be part of every test, with a proportion that increases as students progress through school. To test pupils ability of transfer of taught concepts means to let them apply information, strategies, and skills they have learned to a new situation or context.
- ruszki 6mo agoMy problem with my country of origin’s school system (Hungary) was that this “transfer of learning” was used solely during exams. It would have been really great, that after doing only simple, straightforward exercises during classes or home work, not the exam would have been the first time when students had encountered real world, way more complex exercises. (Btw the other really annoying exam type was when they tested your raw speed of recollection, in other words, whether you did that particular type of exercise a thousand times, and not that you understood or could you do it, like we would have practiced to ER or something where muscle memory can be life or death)
- chongli 6mo agosupposed to test for what? Your ability to synthesize knowledge out of thin air. Yes, actually. Synthesis is the penultimate level of Bloom's taxonomy [1]. Perhaps not appropriate for a first quiz on new material, but absolutely in scope for a final exam. I had many exams in university that challenged me to synthesize a proof to a hypothesis I'd never seen before. I had to bring together my knowledge of the material I'd learned in class with the bit of new material presented in the problem statement, and then devise a proof with one or more steps I'd never done before. Many of my fellow students in first year struggled mightily with questions like this. There was much wailing and gnashing of teeth after the exams. In later years we'd all gotten used to it, and it was to be expected. That students in high school or younger years have been sheltered from synthesis-type problems on exams is a great disservice to them. Edit: I should also note that outside of upper-year pure mathematics courses, synthesis-type problems rarely accounted for more than a third of the grade on an exam. [1] https://en.wikipedia.org/wiki/Bloom's_taxonomy https://en.wikipedia.org/wiki/Bloom's_taxonomy
- knollimar 6mo agoSynthesis problems and time pressure don't feel fair together. I'd be furious to get some lofty theoretical synthesis problem on an engineering exam where the other problems are grindy analysis of "looks like concept you know but expand into a form you haven't seen and then will take 1/n time on your n question exam". I suppose these are already 1 extension in, so 1 more logical extension isn't that far off
- chongli 6mo agoThey're absolutely fair if you're given plenty of practice at them. If the only synthesis problem you see all year is on the final exam then you have a point. However, if you're doing novel (to you) proofs on assignments every week throughout the course, you should be used to the novelty by the time you reach the exam. Expecting a final exam consisting only of calculation and memorization type questions is wholly inappropriate in a mathematics course full of proofs.
- 6mo ago
- nkmnz 6mo agoNot of thin air, but of what you've studied so far. Of course some (many) teachers are imbeciles and just use the same exam they've used in the previous year, even if they haven't covered all the topics yet. But in general, it's a very good idea to have a small question that tests for real understanding, i.e. applying your knowledge to a problem not previously presented, versus mindless reproduction of memorized facts.
- jandrewrogers 6mo ago> Your ability to synthesize knowledge out of thin air. The skill the class is teaching is the ad hoc synthesis of knowledge from other building blocks. That kind of reasoning is most of the purpose of the class; the concepts they teach you are in some sense just a foil for teaching this. The derivation from the concepts you were explicitly taught is pretty trivial and you've had many opportunities to practice. This is common for any kind of systems-y domain. These types of questions were standard on my (physical) engineering exams.