6 ms·
Virtual violin produces realistic sounds
- shooly 6mo agoNot sure if that's news, Audio Modeling[1] has been doing that for quite a long time now. The big plus of physical modeling instead of sampling is disk size - instead of tens of GB of samples, you get a 15MB plugin. It's much more difficult to use, though - you have to control lots of aspects of the simulation (using automation in DAW or MIDI controllers) to make it sound actually realistic. OK I guess it seems like this is more of a tool for luthiers than for composers or music producers. [1] https://audiomodeling.com/ https://audiomodeling.com/
- vintermann 6mo agoThe first version of Pianoteq came back in 2006. There are apparently some exotic mid-90s synths with claims of being physically modeled too, don't know how accurate that is. I currently use a raspberry pi with Pianoteq as sound output for my digital piano. It got a reluctant stamp of approval from my pianist son, although of course he prefers the physical response of even a poor acoustic piano.
- cwillu 6mo agoDo you have an analog sustain pedal? The fine control with partial pedaling made some difference for me re: pianoteq's feel.
- vintermann 6mo agoI don't know how many levels it has, but it's definitively more than 2 :) I am a lousy pianist anyway, it's my son who's serious.
- TheOtherHobbes 6mo agoPianoteq is more like spectral modelling. The sound lacks some of the movement and bloom of a real piano. 90s physical modelling was a very simplified modular kind of modelling. Instead of analogue oscillators and filters you had "string" models, "pipe" models, various resonators, and so on. The models were interesting, but still quite crude and basic. This project is the most physical kind of physical modelling. It's an unsimplified brute-force model of the entire instrument body and string system, in full. It doesn't try to "model a resonator", it models blocks of wood with various holes, and calculates how they distort and radiate as sound passes through them. It's ridiculously expensive computationally, but it's also the only way to get all of the nuances of the sound. I expect they're already working on a stick-slip model for bowing. Theoretically you could use the same technique to model a piano or guitar, and you would get something indistinguishable from a real instrument. You'd likely need a supercomputer to run the model in anything approaching real time. But the advantage is that once you've got it you can do insane things like replace the strings with wood instead of metal, or use different metals, or "build" nonphysical pianos that are fifty feet long and have linear overtones all the way down to the bass.
- vintermann 6mo agoPianoteq was quite heavy computationally when it came, it still is, arguably. It was a challenge to get it to run on a raspberry pi 4 in real time. I can tell the difference between Pianoteq and a real piano, but I can't in general tell the difference between Pianoteq and a recording of a piano. Maybe there's some insane level of hi-fi gear which would let me, idk? But in general, when it's good enough for Steinway, Petrof and my conservatory student son to give their stamp of approval, I think it's good enough for me as well :) quite a few of those insane things you mention you can already do with pianoteq's physical model (i.e. emulating a 20m grand), and I suspect they keep a few knobs to themselves to sell virtual instruments.
- iainmerrick 6mo agoI can tell the difference between Pianoteq and a real piano, but I can't in general tell the difference between Pianoteq and a recording of a piano. That's a great way to put it. There's no way to fully reproduce that live sound, but compared to anything played through speakers, Pianoteq is indistinguishable from a real piano. Out of the box it sounds a little too perfect, but just setting the Condition to the midway point (1.0) fixes that.
- seedlessmike 6mo agoPianoteq is amazing with a good controller like a big Kawai VPC1 or the fanciest Fatar action in the Studiologic "GT" models. It is very responsive. I've been using it for over a decade and the sound keeps improving. The combination of pianoteq and a sample based piano is pretty nice too, though tough to do on a Pi. Good speakers improve the experience because you get your room resonance etc. The coolest thing - you can change temperament. So if you are playing music from before equal temperament, you can hear what different keys used to sound like! Very interesting especially with Bach. I agree with your son, there is nothing like a real piano. There are interesting attempts at combining the digital and mechanical with soundboard transducers from Kawai and Yamaha, I haven't used them but I would like to.
- mchinen 6mo agoBowed instruments are very cool to model because of the nonlinear slip of the bow against the string. A bit curious why bowing was not discussed or used in the example of a violin, just plucking. Do luthiers test violins more by plucking than bowing?
- nwatson 6mo agoIt's probably harder to model and the results "aren't quite there yet".
- deleted 6mo ago[deleted]
- tkocmathla 6mo agoThey briefly address this in the article: > Violin bowing, the researchers say, is a much more complicated interaction to model.
- mchinen 6mo agoThanks, I missed that.
- orthoxerox 6mo agoSomeone made a virtual car engine that was able to generate realistic sounds a few years ago. https://www.youtube.com/watch?v=RKT-sKtR970 https://www.youtube.com/watch?v=RKT-sKtR970
- superpope99 6mo agoThe coolest thing about this to me is that he managed to plug a trumpet into the same engine and it sort of... Just worked
- zokier 6mo agoReminds me of this last years siggraph paper about cello playing animation https://youtu.be/ODR6eQOjm9w https://youtu.be/ODR6eQOjm9w https://github.com/Qzping/ELGAR https://github.com/Qzping/ELGAR It's just fun to see solutions to problems you didn't even know to exist.
- arstep 6mo agoit doesn't sound as a real violin at all. A professional violinist would immediately tell that something is wrong.
- ioseph 6mo agoAs an amateur violinist and synth enthusiast it sounds tinny and dry
- rpozarickij 6mo agoI've played other instruments (not very professionally) for 10y when I was much younger but was often surrounded by sounds of violins and these don't sound realistic at all. My main instrument was the saxophone and whenever I hear AI/artificial saxophone somewhere I can notice it right away, but I'm very curious if I've ever been a victim of the toupee fallacy. I wonder whether there's a good test/game where you have to guess whether a given sound of a musical instrument is real or not.
- nosioptar 6mo agoCellist with ~6 years experience in a chamber orchestra: gun to my head, I'd have never guessed the sound was supposed to be a violin.
- codedokode 6mo agoYou don't even need to be a violinist to hear that.
- soupspaces 6mo agoWould a virtual ear?
- zebproj 6mo agoThe article makes it sound like this is a very a new idea, but physical models of music instruments, including violin, has been around for over 40 years. Daisy Bell, the first piece of computer music and performed by their model, utilized a physical model of the human singing voice based on measurements of human vocal tract, and that was done in 1962. Julius Smith wrote pretty comprehensive textbook on the subject of building physical models of musical instruments, available online. Here, for example, is a chapter on modeling bowed string sounds: https://ccrma.stanford.edu/~jos/pasp/Bowed_Strings.html https://ccrma.stanford.edu/~jos/pasp/Bowed_Strings.html
- HelloUsername 6mo ago> Daisy Bell, the first piece of computer music and performed by their model, utilized a physical model of the human singing voice based on measurements of human vocal tract, and that was done in 1962 From the article: > As a demonstration, the researchers applied the computational violin to play two short excerpts: one from “Bach’s Fugue in G Minor,” and another from “Daisy Bell” — a nod to the first song that was ever produced by a computer-synthesized voice.
- cozzyd 6mo agoI have to say JOS was possibly my favorite instructor in undergrad....
- BJones12 6mo ago> physical models of music instruments... has been around for over 40 years And in consumer products for 20+. Pianoteq [0], which is awesome, was first released in 2006. [0] https://en.wikipedia.org/wiki/Pianoteq https://en.wikipedia.org/wiki/Pianoteq
- vunderba 6mo agoPianoteq has mostly replaced my old Kontakt libraries in my DAW outside of course, miking my actual piano. Also Audio Modeling has been in the business of creating physically modeled virtual instruments, including the violin (under the SWAM series), for a while now as well. You can do pretty fun things like map a USB breath controller to bow pressure, etc. https://audiomodeling.com/products/swam-violin https://audiomodeling.com/products/swam-violin
- HelloUsername 6mo agoSemi-related? "Show HN: Anyma V, a hybrid physical modelling virtual instrument" 01-aug-2024 https://news.ycombinator.com/item?id=41132104 https://news.ycombinator.com/item?id=41132104 29 comments "Show HN: I built a synthesizer based on 3D physics" 02-may-2025 https://news.ycombinator.com/item?id=43873074 https://news.ycombinator.com/item?id=43873074 123 comments
- florilegiumson 6mo ago“As it is, the new computational model is the first to generate realistic sound based on the laws of physics and acoustics.” Ouch: this is completely inaccurate. Physical modeling has its roots in the 80s and Stefan Bilbao has been doing FDM based methods for over 20 years. I think he discusses fem in numerical sound sysnthesis
- yummybrainz 6mo agoI'm assuming the intended meaning is that this was the first time the approach led to "realistic" sound?
- moralestapia 6mo agoThat's also not the case. There have been some really accurate physically-modeled instruments for at least 20 years. Also, aschkually, a violin is on the "easier" end of making it sound realistic. It's one of the "tutorial" models you go through when you start learning about this (resonators + reverb get you 80% there). Much harder to do any plucking sound (guitar, piano), and much much harder to model percussions accurately (cymbals, drums) and in such a way that the sound doesn't come out dry and very evidently synthetic. Source: I was very invested into this in the 2000s, although as a hobby, not professionally.
- InitialLastName 6mo agoDo you know if there has been any progress on conical-bore brass? From what I recall (I did some graduate work in instrument modeling in the late 2000s) reed instruments could be modeled convincingly, but the feedback oscillator with the lip buzzing was very difficult to model.
- matheist 6mo agoThere's eg https://summit.sfu.ca/item/11130 https://summit.sfu.ca/item/11130 from a Tamara Smyth and Frederick Scott; Google scholar shows some citations but not necessarily conical brass in particular. That link is about trombones, so also not conical. (I read that and tried to implement some stuff in it, see https://nuchi.github.io/trombone/ https://nuchi.github.io/trombone/ for a browser-based playable version.) Conical and cylindrical bores definitely differ but I don't see why they'd be different specifically with respect to the lip interaction, can you say more about that part?
- MITSardine 6mo agoAs a disclaimer I haven't read the article, nor do I know much about simulating instruments in particular, but I just wanted to point out that accurately simulating the physics of a musical instrument is most likely still a very difficult problem. I have no doubt there's been analytical/semi-analytical models around for decades. I mean a program that can take an arbitrary geometry or class thereof with specific materials and simulate the high frequency vibrations and model interactions with the body with high fidelity (not through ad-hoc models) is probably still out of scope of real time simulation. My point is really that there's often families of models that deal with one thing, from semi-analytical first coded in Fortran in the 80s that can run in milliseconds but is only valid in certain configurations with a low degree of accuracy, to "first principles" simulations that may well require a supercomputer to produce results to a useful degree of accuracy (and not in real time). So, just because you see someone claim they can "simulate X", and then another makes the same claim 40 years later, that doesn't mean they're doing the same thing. For instance, aeronautics has XFOIL. It's a semi-analytical model first devised in the 80s that computes aeronautics coefficients for a certain class of airfoils (NACA). My understanding is it's a very clever, and industrially significant, piece of code, but ultimately it works in a narrow regime with some heavy simplifications. You can now get results from this in real time on a webpage. A proper CFD calculation to a NACA wing will take in the order of minutes to hours on a workstation (depending on requested precision and settings, e.g. speed of air), and while closer to first principles, it's still using physical simplifications (RANS). So yeah, although nominally people have been "simulating airfoils" for 40 years, the techniques have refined considerably, and will continue to do so (practical LES and, someday, DNS). It might be another century that people are still "simulating airfoils" in ever more accurate (nailing down within the constraints), high fidelity (lifting constraints) and generic ways. Back to instruments, this is a difficult coupled problem, in fairly high frequencies (high frequencies = more expensive), with possible fluid-structure interactions, not to mention the geometries are fairly complex (to even get a workable mesh to begin with). My uneducated guess is we're still at either semi-analytical, or at the "considerably simplified first principles" stage for this type of problems. Just like DNS, I'm sure you could "just resolve the scales and run it through a simulation with a really tiny time step", and this is liable to be similarly expensive as DNS (million dollar single simulation). Additionally, they have to deal with the human ear, which is perhaps more unforgiving than an error plot on drag or lift. So I wouldn't dismiss news of instrument simulation as stale just because someone made something that produced similar artifacts in the past, as the methods will continue to evolve considerably.
- xphos 6mo agoAs someone who plays the violin very poorly I don't think this sounds like violin at all. It is very folksy synthetic sounding. They are clearly plucking but it sounds similar to if you were bowing its really strange. I definitely could replicate that quality of model but I think I have heard much better models elsewhere
- infinitewars 6mo agoIt was a finite element simulation of a CT-scanned violin, but as they note, “If there’s anything that’s sounding mechanical to it, it’s because we’re using the exact same time function, or standard way of plucking, for each note,” says Makris, who is himself a lute player. “A musician will adapt the way they’re plucking, to put a little more feeling on certain notes than others. But there could be subtleties which we could incorporate and refine.”
- xeonmc 6mo agoIn addition, the resonant characteristics of the bow also contributes significantly to the sound, as it feeds directly back to the stick-slip contact that is more akin to a mode-locked laser’s nonlinear dynamics. The violin body’s resonant characteristics in comparison is more like a passive filter.
- esafak 6mo agoIt sounds more like a banjo to me. Not at all like a violin.
- xphos 6mo agoI was rude here I meant to say I couldn't produce that model. I see the other comments but just vibes here. It sounds strange, I read some of the comments and the article again and I just think what makes the violin juicy is the dynamic instability of everything. The best violinist in the world would struggle to play a song the same exact way every single time. Not that they would be making mistakes but the slightest varriation of bow pressure or starting position echos through a piece. Perhaps the simulation of just one pluck is why it feels so synthetic
- docheinestages 6mo agoThe plucking demo was disappointing. How does it compare to something like the SWAM Engine[1]? Given the title, I was expecting more. [1] https://www.youtube.com/watch?v=UB-5uPcWVVE https://www.youtube.com/watch?v=UB-5uPcWVVE
- Tade0 6mo ago> It produces sound based on the way the instrument, including its vibrating strings, physically interacts with the surrounding air. I suppose this is the innovative part. They're not simulating just the string, but also the fluid it's immersed in, which is a computationally hard problem. I made a vibrating string simulator in college for our Numerical Methods course and for quite a while I couldn't understand why it sounded so bad. Turns out rounding errors in floating point operations can propagate to a point where they produce this distinct, "metallic" sound. They're incredibly small, but if your system of differential equations is large enough, they'll become noticeable. Switching to an algorithm with better numerical stability would probably mitigate this issue, but I didn't get that far with my project.
- jancsika 6mo ago> Turns out rounding errors in floating point operations can propagate to a point where they produce this distinct, "metallic" sound. Reminds me of a Karplus-Strong synthesis implementation that produced a gorgeous guitar/mandolin sound, but only for delay durations that weren't simple ratios with the given sample rate. The simple-ratio durations would end up sounding like crude, attenuated periods of noise-- metallic sounds like you'd expect from a pitch produced in a KSS demo. Everything else had some kind of subtle interpolation error that ended up shaping the noise just enough to make it sound like a million bucks. The problem with most KSS is that the filter used will typically saturate the timbre. So rather than hearing a guitar string, you're hearing a guitar-adjacent interpolation scheme whose prominence makes you wonder just how un-guitarlike the original unfiltered sound must have been.
- Tade0 6mo agoThat's really hellish, considering 44.1k is divisible by numbers 1-10 and more.
- jancsika 6mo agoNow that I think of it, the problem may have been independent of the sample rate. It may have just been all periods that were integers. So A440 sounded like a guitar string because it's a period of about 2.72ms. But at 1000Hz you're suddenly transported to a sound-effect from a 1970s episode of Dr. Who.
- pierrec 6mo agoIn this area of research, there's this classic trap that many fall into (including myself, many times). You focus on modeling things like the vibrating string, the resonant body, etc. to perfection. But it still sounds, uh, not great, because the more important and difficult part is modeling detailed control and the human/instrument interface. Air fluctuations around the violin sound like a fun experiment, but I don't think you'll get much additional realism from that, compared to a simple/classical impulse response model. Even in this case, they're choosing the easy path (plucked, pizzicato), but the human/instrument interface is still audibly oversimplified while the resonant body has an unnecessary amount of "realism". The sound of pizzicato has a distinct character because the player's finger/skin slides a bit on the string as they're plucking, among other factors, which sounds like it's missing here. This can be tricky to implement because it's not necessarily a one-way impulse. The string is already vibrating and affects the finger, hence "interface". This applies 10x more with bowed strings.
- shiandow 6mo agoPut differently, it takes years of practice to get a decent sound out of a real violin. If your model doesn't sound like someone's strangling a cat then it's probably not realistic.
- saidnooneever 6mo agoits not _that_ hard -_-. just that a lot of music on violin played solo is acquired taste... just like many flutes, or drums. the real sound comes when its played with other instruments in concert. it doesnt need years of practice it needs patience the right setting and an extra joint on ur pinky :p
- shiandow 6mo agoMy experience may be a bit biased by having to listen to children attempting to learn the instrument.
- saghm 6mo agoI think it's hard in comparison to non-bowed string instruments. Even someone on their first day playing a guitar can pluck a single open string and not have it sound terrible, but getting a decent tone when bowing an open string on a violin is something that might take months for someone to do even sometimes.
- tylershamy 6mo ago[flagged]
- jackmalpo 6mo agoare the realistic sounds in the room with us?
- yboris 6mo agoFor piano, look at Pianoteq - 50MB of math code that simulates $100k+ pianos, letting you adjust and fine-tune numerous parameters (lid position, microphone placement, etc), no sound-banks used! https://www.modartt.com/ https://www.modartt.com/
- codedokode 6mo agoI never held a violin, but the demo sounds like some keyboard instrument, as if there were a hammer striking a metal bar or something like this. (I even checked the sound of violin on Youtube to be sure).
- pawelos 6mo ago> luthiers, often must wait until the instrument is finished before they can hear how all their hard work will sound. My father is a luthier, and while he definitely needs to wait until the instrument is finished to hear the full sound, he also uses multiple techniques on parts of an unfinished violin to hear *some* sound. For example, he knocks on the top or back plate and listens to the sound it makes. I don’t know how much of it is just voodoo, but he’s been doing it for 50 years, so I’m sure he noticed some correlation to the final sound by now. :) I'll have to ask him.
- RickJWagner 6mo ago“Violin makers, aka luthiers”…. Lest anyone be confused, luthiers work on any stringed instrument with a neck. Guitars, banjos, etc.
- markatto 6mo agoLutes, even!
- RickJWagner 6mo ago“Violin makers, aka luthiers”…. Lest anyone be confused, luthiers work on any stringed instrument with a neck. Guitars, banjos, etc.
- russellbeattie 6mo agoApparently, the shape of a peeled orange (a flattened sphere) is unrelated to a violin's f-holes. I had it in my mind that the S-shapes were similar for acoustic reasons. Looking it up just now, it turns out that, "Modern physics research shows that the f-shape allows the instrument to push much more air than a traditional round hole, resulting in greater acoustic power and projection." Just wanted to share in case someone else had that same bit of false knowledge in their head.
- odyssey7 6mo agoThis is getting a lot of criticism but as a demo I think it sounds nice.
- njonsson 6mo agoThe sound is more like that of a kayagŭm (a Korean traditional instrument) than violin pizzicato.
- p0w3n3d 6mo agoAs a person who struggles to learn violin, I say that to me this doesn't sound like a violin. More like muted harp
- _s_a_m_ 6mo agoSorry but that quote about know how the sound changes before carving is just straight up student bullshit. That's not how building a violin works, it is not a physics problem, it is material matter, it is a taste matter, it is a matter of adapting to material what you have, ...