4 ms·

>If you had any Android developer experience, you would surely know that Google had a few failed attempts at real time audio, needed help from Samsung to implem

by 0xFFC 9y ago

>If you had any Android developer experience, you would surely know that Google had a few failed attempts at real time audio, needed help from Samsung to implement them, and the final API was C only, with devs asking for a C++ one, wich was later dumped on github as side project and isn't part of the official NDK APIs, but alas you don't. Would you mind to explain what happened completely? I am very curious about it. Thank you so much ;)

pjmlp 9y ago
Sure. Originally Android only had the Java media APIs, with a quite complex state. https://developer.android.com/reference/android/media/MediaPlayer.html https://developer.android.com/reference/android/media/MediaP... Android 2.3 introduced OpenSL ES into the NDK and Android 4.0 got OpenMAX. All of them weren't up to the game of realtime audio due to the Android architecture. http://superpowered.com/androidaudiopathlatency http://superpowered.com/androidaudiopathlatency https://nsr.cse.buffalo.edu/wp-content/uploads/2016/10/rtdroid-sound-jtres16.pdf https://nsr.cse.buffalo.edu/wp-content/uploads/2016/10/rtdro... https://www.androidauthority.com/android-6-0-marshmallow-audio-latency-670727/ https://www.androidauthority.com/android-6-0-marshmallow-aud... There are plenty of other articles online when you search for audio issues on Android. There was even a Google IO 2013 talk about it. https://www.youtube.com/watch?v=d3kfEeMZ65c https://www.youtube.com/watch?v=d3kfEeMZ65c Meanwhile Samsung had customized their Android versions to properly support real time audio and offered an SDK for their handsets. http://developer.samsung.com/galaxy/professional-audio http://developer.samsung.com/galaxy/professional-audio At Google IO 2016 the problem was again discussed, with the Samsung team from Professional Audio being called on stage to discuss their collaboration. https://www.youtube.com/watch?v=F2ZDp-eNrh4 https://www.youtube.com/watch?v=F2ZDp-eNrh4 Finally last year at Google IO 2017, the new real time audio was announced, as C only lib. https://www.youtube.com/watch?v=C0BPXZIvG-Q https://www.youtube.com/watch?v=C0BPXZIvG-Q https://developer.android.com/ndk/guides/audio/index.html https://developer.android.com/ndk/guides/audio/index.html The announced C++ wrapper ended up being an external project on github, detached from the NDK, that you need to integrate yourself, without any guarantees how long Google will care to maintain it. Oh, to make things even better, it is already clear from Android P draft documentation that new audio APIs are on their way.

by 0xFFC 9y ago

pjmlp 9y ago

Sure. Originally Android only had the Java media APIs, with a quite complex state. https://developer.android.com/reference/android/media/MediaPlayer.html https://developer.android.com/reference/android/media/MediaP... Android 2.3 introduced OpenSL ES into the NDK and Android 4.0 got OpenMAX. All of them weren't up to the game of realtime audio due to the Android architecture. http://superpowered.com/androidaudiopathlatency http://superpowered.com/androidaudiopathlatency https://nsr.cse.buffalo.edu/wp-content/uploads/2016/10/rtdroid-sound-jtres16.pdf https://nsr.cse.buffalo.edu/wp-content/uploads/2016/10/rtdro... https://www.androidauthority.com/android-6-0-marshmallow-audio-latency-670727/ https://www.androidauthority.com/android-6-0-marshmallow-aud... There are plenty of other articles online when you search for audio issues on Android. There was even a Google IO 2013 talk about it. https://www.youtube.com/watch?v=d3kfEeMZ65c https://www.youtube.com/watch?v=d3kfEeMZ65c Meanwhile Samsung had customized their Android versions to properly support real time audio and offered an SDK for their handsets. http://developer.samsung.com/galaxy/professional-audio http://developer.samsung.com/galaxy/professional-audio At Google IO 2016 the problem was again discussed, with the Samsung team from Professional Audio being called on stage to discuss their collaboration. https://www.youtube.com/watch?v=F2ZDp-eNrh4 https://www.youtube.com/watch?v=F2ZDp-eNrh4 Finally last year at Google IO 2017, the new real time audio was announced, as C only lib. https://www.youtube.com/watch?v=C0BPXZIvG-Q https://www.youtube.com/watch?v=C0BPXZIvG-Q https://developer.android.com/ndk/guides/audio/index.html https://developer.android.com/ndk/guides/audio/index.html The announced C++ wrapper ended up being an external project on github, detached from the NDK, that you need to integrate yourself, without any guarantees how long Google will care to maintain it. Oh, to make things even better, it is already clear from Android P draft documentation that new audio APIs are on their way.