8 ms·

Show HN: I 3D scanned the tunnels inside the Maya Pyramid Temples at Copan

462 points by lukehollis 2y ago

With these 3d captures, you can explore the 4km tunnel system that archaeologists created inside the temples at Copan that are closed to the public. The tunnels are often flooded by hurricanes and damaged by other natural forces--and collapsed on me and my Matterport scanner more than once--so this is a permanent record of how they appeared in 2022-23. Unlike Egyptian pyramids, the Maya built their temples layer by layer outward, so to understand them, researchers tunneled into the structures to understand the earlier phases of construction. I arranged the guided versions of the virtual tours in a rough chronology, moving from the highest to the lowest and oldest areas: the hieroglyphic stairway composing the largest Maya inscription anywhere, the Rosalila temple that was buried fully intact, and finally the tomb of the Founder of the city, Yax Kʼukʼ Moʼ. I've been working to build on top of the Matterport SDK with Three.js--and then reusing the data in Unreal for a desktop experience or rendering for film (coming soon to PBS). Blog about process: https://blog.mused.com/what-lies-beneath-digitally-recording-over-4km-of-tunnels-inside-the-maya-temples-at-copan/ https://blog.mused.com/what-lies-beneath-digitally-recording... Major thanks to the Matterport team for providing support with data alignment and merging tunnels while I was living in the village near site.

mmh0000 2y ago
I don't know which is cooler. The 3D scan itself or the 3D map in the browser. This is amazing. Thank you for sharing.
- lukehollis 2y ago
  Thanks for visiting! It was so many tunnels.. I feel bad that I don't build faster sometimes, but this took awhile.
  - iwontberude 2y ago
    Get used to slowing down, it’s inevitable and you shouldn’t hold yourself to an unreasonable standard. Biology’s first principles make this clear.
    - lukehollis 2y ago
      It was specifically the time in the tunnels from 6:00 AM - noon every day that was an out-of-the-ordinary time and energy investment. It was necessary to be there, so I evaluated as "do things at dont scale."
23B1 2y ago
Luke I'm so happy to see you here on HN. What you and the Mused team are doing is incredible.
- lukehollis 2y ago
  Wow, thanks so much! I don't recognize your un, who is this? But thanks again!
  - 23B1 2y ago
    I'm a nobody, but I've stumbled across your site before. Kudos and be sure to let the HN community know how we can help.
throwup238 2y ago
Very well done! I was pleasantly surprised how well this works on a phone. Did you take any scans after sections collapsed? Would love to hear more about what happened.
- lukehollis 2y ago
  Matterport's SDK is so good -- I'm so impressed with the details like mobile performance the more time I spend building with it. I did take some scans after the collapse! After we'd dug ourselves out and crawled out on our bellies, I went back with Polycam. The collapsed section we dug through was comparatively small, maybe 4-5 meters: Section 1: https://poly.cam/capture/4BB863F2-1CC3-46E3-8BDB-232EE3057BD3 https://poly.cam/capture/4BB863F2-1CC3-46E3-8BDB-232EE3057BD...? (you can see where we crawled out to the intersection here -- the whole intersection had ceiling collapse, but only the section we dug out through was fully covered). Section 2: https://poly.cam/capture/3C5BB7BD-5FC9-4C00-AE1C-84E0544C51CF https://poly.cam/capture/3C5BB7BD-5FC9-4C00-AE1C-84E0544C51C... We're just lucky it wasn't a rocky ceiling that fell, that would've been much worse. The team taking care of the tunnels is doing an amazing job with the resources they have, and they're continually backfilling tunnels now and maintaining the ones that are there. It took us about an hour to dig out. You can compare to the intersection in the matterport version in the same vicinity: https://my.matterport.com/show/?m=r5BR6K6Qxix&ss=338&sr=-.21,-.23 https://my.matterport.com/show/?m=r5BR6K6Qxix&ss=338&sr=-.21... I don't want to editorialize too much, but at that moment we were totally brothers--I was still early with Spanish, and the language, country, age differences fell away, and we dug ourselves out.
downboots 2y ago
The transitions are much smoother than Google street view
- lukehollis 2y ago
  Matterport works special magic on the transition between 360 images in their SDK. As far as I understand it, they render 360 cube camera onto the material of the mesh of the environment as you move so it looks like you're moving in the real mesh but only seeing the 360 image. I tried to approximate this myself in Three.js but didn't get anywhere near the quality or performance of their work. Homage.
- nh2 2y ago
  If you like smooth transitions, check my startup's: https://benaco.com/go/k4-green-hn-2024 https://benaco.com/go/k4-green-hn-2024
  - lukehollis 2y ago
    These look great! What strategy did you use to do the transitions?
    - nh2 2y ago
      It works as you described: Texturing the mesh "live" as you move through it. It does use Three.js as a base, but needs custom shaders to make it 60 FPS.
      - lukehollis 2y ago
        Very cool.. bravo -- it looks so good
01HNNWZ0MV43FF 2y ago
That is so cool. Is it hard to avoid integrator error in long tunnels?
- lukehollis 2y ago
  It is so hard! The long tunnel sections were the worst, but thankfully most of them had multiple join points, like in the Temple 16 / Rosalila temple excavations.
oidar 2y ago
I love all these Maya inscriptions. I hope more are discovered (and hopefully some manuscripts) - the little we do have of Maya text is amazing. What are your top 3 things to tell people at parties that no little about Maya?
- lukehollis 2y ago
  I love the inscriptions too--the stela only get more meaningful the more you learn about them. But it's kind of like Egypt, the iconography is harder to understand because we inherited from a different culture. For me, the Maya have always been important because they're our history and our stories in the Americas (I'm from the US) -- more than the greco-roman mythology I grew up with. They grew corn and love ball games. Their stories are more directly our stories, and their struggles are our struggles. Not to be political, but they also kind of wiped themselves out by large scale environmental collapse, and the jungle is filled with their undiscovered monuments. There's still so much to learn. People really geek out on how much the Maya knew about astronomy too -- they shot archaeoastronomy docs twice while I was working on site. Richard Feynman even helped decipher Maya glyphs and writes about it in "Surely you're joking Mr Feynman". He gave a lecture also if the audio file can be checked out somehow: https://collections.archives.caltech.edu/repositories/2/accessions/2659 https://collections.archives.caltech.edu/repositories/2/acce...
  - tonyg 2y ago
    Feynman was very interested in Maya writing, but made no useful contribution to its interpretation. Credit for that goes to Knorozov and many others (https://en.wikipedia.org/wiki/Maya_script#Decipherment); https://en.wikipedia.org/wiki/Maya_script#Decipherment); Feynman's approach followed Thompson's, which we know now to be incorrect.
    - lukehollis 2y ago
      Thanks for the correction!
cynicalpeace 2y ago
This reminds me of a recent Lex Fridman podcast with an expert in ancient American civilizations: https://www.youtube.com/watch?v=AzzE7GOvYz8 https://www.youtube.com/watch?v=AzzE7GOvYz8
voodooEntity 2y ago
The fact that people carved this tunnels with simple tools and their bare hands into the underground is so freaking amazing i cant find better words for it Edit: also very nice tool :)!
- AStonesThrow 2y ago
  > The fact that people carved this tunnels with simple tools and their bare hands I'm confused, mate: why and how would 21st-century professional archaeologists avoid using modern powered tools and techniques? That's absurd, dangerous, and not cost-effective.
  - mxmilkiib 2y ago
    I think you misunderstood that comment a bit
    - AStonesThrow 2y ago
      I think the commenter misunderstood the article a bit. I was trying to give benefit of the doubt.
TheCleric 2y ago
This is great! Great job!
- lukehollis 2y ago
  Thanks!
everly 2y ago
Definitely one of the better implementations I've seen using Matterport's SDK, nice work. Did you use the Pro3 as the capture device? Before the collapse anyway!
- lukehollis 2y ago
  Thanks, and I was still on Pro 2 + BLK 360 unfortunately. Haha, thankfully all the cameras survived and made it home, just muddier.
  - everly 2y ago
    Oh man, the BLK360 can be a frustrating (albeit incredible) device even in the best of conditions, let alone this. Glad to hear everything survived! I mostly use the Pro3 now but did a big chunk of this Georgia Tech scan with the BLK: https://my.matterport.com/show/?m=PB8FgAyyjHx https://my.matterport.com/show/?m=PB8FgAyyjHx
    - lukehollis 2y ago
      Haha, yeah I know what you mean. I had to do the exterior with the BLK for only a few hours each morning before it overheated. That's an impressive huge capture!
rendall 2y ago
Amazing. So inspiring!
- lukehollis 2y ago
  Thanks so much!
farhaven 2y ago
This is very cool! Can you share the technical background you've used for creating the 3D reconstruction? Like software packages, or algorithms used. Are we looking at the result of packages like OpenSfM here, or COLMAP?
- lukehollis 2y ago
  Onsite I used the Matterport capture app and Matterport Pro 2 and BLK 360. For the web version linked here, I built on top of the Matterport SDK with Three.js https://matterport.github.io/showcase-sdk/sdkbundle_home.html https://matterport.github.io/showcase-sdk/sdkbundle_home.htm... So in the virtual tour, you're seeing 360 imagery from the cameras and a lower resolution version of the 3d capture data, optimized for web. The lower res mesh from the scanner is transparent in first-person view mode so users get cursor effects on top of the 360 image. For film, PBS sent out a documentary crew, and they wanted me to render some footage of the full tunnel system, so I exported the e57 pointcloud data from Matterport and rendered the clips they needed in Unreal. It should be coming out soon with "In the Americas."
- deleted 2y ago
  [deleted]
renewiltord 2y ago
Does anyone know if there’s a simple solution to generating NeRFs from a continuous all directional camera (like a GoPro Max). It would be fun to make an explorable universe like that.
- lukehollis 2y ago
  You should be able to do this with nerfstudio: https://github.com/nerfstudio-project/nerfstudio/ https://github.com/nerfstudio-project/nerfstudio/ I've done it a few times, you can test 3d Gaussian Splatting also instead.
  - renewiltord 2y ago
    Thank you! That's terrific.
  - smusamashah 2y ago
    Hadn't seen this comment before. Why is this one not Guassian Splats or nerfs?
jofla_net 2y ago
This is great use of the technology. There should be scans of all our national monuments, world wonders, etc. So much better a use for the tech than just Redfin.
- volk45 2y ago
  Popping my comment cherry here! I’m a 3D artist that is currently encountering staunch resistance of generating 3D models from drone captured photogrammetry of historically protected sites in Pennsylvania, USA. I’ve had resistance from the state and county level in pursuing take off and landing permission at historical sites. Communicating my intentions of digital historic preservation with photogrammetry has been a difficult “sell”. I’m a licensed commercial remote pilot - however I need property owner permission to take off and land. Many sites are in state/county owned property in my area.
  - lukehollis 2y ago
    Hey I'm really sorry! It's really hard. My photo permissions at Giza took two years to secure. My only advice is to keep showing up in person and hang in there--I feel for you!
    - volk45 2y ago
      That’s some incredible perseverance from you! In person is the right move though. Getting FaceTime in with groups or people who are part of the process does seem to make the best headway.
  - seabass-labrax 2y ago
    Have you looked to see whether there is a local archaeology or social history society in your area that you could join? They will have individuals involved who are already used to dealing with property owners to arrange research projects, and you might be able to accompany them on the trips they organize. For reference, the archaeological society in my region serves around 400 square miles and typically organizes a low two-digit number of digs every year. There are also some other societies in the same region who focus on preserving and documenting recent history where excavation isn't required. Another idea: if you don't already have any formal education in history, you could study for some qualifications in the subject. It would probably do much to reassure landowners that you are not going to harm the sites in any way (although I struggle to think of a way you could do so with a UAV!) In any case, good luck; I'd love to see the models!
smusamashah 2y ago
This is great. I think you shared 3d scan of some other pyramid sometime ago here on HN. I think you should try processing this data through a Guassian Splatting software. I have no idea how many images Guassian Splats require to work well or the CPU/GPU requirements but I have seen very very cool Guassian Splatting demos on twitter where you can absolutely freely fly around the scene and view it from any angle.
- lukehollis 2y ago
  Hey, yeah that was me. I spent quite a bit of time last year using pre-existing scanner positions to train nerfs/splats and didn't get anything that was usable, unfortunately. I ended up shifting to Unreal for a higher graphics tier, so if you want to see the Great Pyramid of Giza interior in the highest quality level, you can here: https://mused.com/netherworld-ancient-egyptian-afterlife-simulator/ https://mused.com/netherworld-ancient-egyptian-afterlife-sim... For Unreal I used a few methods but mostly conventional photogrammetry incorporating the lidar. Ultimately, I'm hoping that downloading the file or some type of pixel streaming for web until the nerfs or splats -- or whatever follows them -- works out.
  - ftrsprvln 2y ago
    Really appreciate the use of technology to make sites like these accessible to the world at large. Just wanted to share that I am in the middle of a very similar project with a high profile client & the workflow we settled on has loosely been Lidar scans -> Postshot -> Supersplat (web optimization) -> Babylon.js. Of course we have video/image fallbacks & an unreal pixel streaming version as well - but the web performance and results on a modern mobile device have been spectacular so far! So excited for the future of gaussian splatting :)
    - lukehollis 2y ago
      Wow, thanks for writing -- would love to see what you're building when you have a link to share! My emails in my profile or just will keep an eye out in general for this workflow.
hexnuts 2y ago
Is there any plans to support a WebXR interface in the future?
- lukehollis 2y ago
  Yes, these scans also work in WebXR using Matterport's default VR viewer -- I have a basic page setup at https://mused.com/vr/ https://mused.com/vr/ -- but I'll get the Copan tours added there.
programd 2y ago
I'm glad to hear you're working on getting an Unreal environment for these scans. I find the movement in the web version to be incredibly clunky. This really needs to have a game like environment to do it justice. In general we clearly have the technology to capture 4K-8K environments and turn them into very realistic virtual worlds. Is anybody even doing such work? For example capturing a neighborhood in San Francisco (or any city) as it looks in 2024 for historical reference? Seems like that should be a thing. I've seen high quality environmental scans, even way back in the Silicon Graphics days when they showed an amazing scan of the Sistine Chapel. But it seems to me all such scans wind up in some proprietary player format which was designed by somebody who never played a decent open world game like Fallout 4, Cyberpunk, Battlefield, Red Dead Redemption. I have yet to see a museum environmental scan which gets anywhere near the immersive quality of those games. This is not so much a criticism of such work - it's awsome! - but maybe more of a call to arms for game people to help out the scholars.
- namibj 2y ago
  I was working towards that aiming at the medieval city of Rothenburg o.d.T. in Germany. Unfortunately it's a lot of code writing to support rolling shutter cameras strapped to multicopters, where you capture video with short enough exposure to prevent blur. The 3D recovery has to respect the fact that the rows of the image are taken from different positions and angles, causing this up infiltrate basically the entire pipeline. And global shutter cameras are barely accessible. If there's some group with the man power and funding to actually pull this off, please get in touch, I would like to pick back up!
- lukehollis 2y ago
  You can download or test the Unreal version pixel streaming here: https://mused.com/netherworld-ancient-egyptian-afterlife-simulator/ https://mused.com/netherworld-ancient-egyptian-afterlife-sim... Or here's the trailer for the project in Unreal: https://www.youtube.com/watch?v=hlNgpG9X7mc https://www.youtube.com/watch?v=hlNgpG9X7mc I have a lot of work keeping up with games, it's true--games are expensive to build and aiming at photorealism art style continually looks dated quickly while stylized graphics, less so. I'm trying to fundraise to build this game currently, but it's a tough sell. Educational games don't do well on Steam, so right now, I'm just distributing through my website as I build. The small income this provides helps me contribute back to the modern Egyptian Egyptologists that are excavating and documenting their own culture though. The latest Game Science title, Black Myth Wukong, does an awesome job with 3d captures of Chinese monuments and bringing the mythology and history to life.
gerdesj 2y ago
Superb! I expect whoever coated the remains with that red cinnabar stuff died rather early, probably with tooth and hair loss and severe mental issues. Perhaps this fate was expected but given that "mad hatters" were a thing until fairly recently, people can be a bit strange when it comes to dealing with poisons. The guide notes point out that only the most sacred rituals involved this red mercurial stuff. I'm not surprised. It might be rare but rarer still will be people willing to deploy it unless that fate is considered a good way to go. That tour is a remarkable use of the technology.
- lukehollis 2y ago
  It's something we have to be careful of while working on site! We're really careful around the rooms that have mercury in them--there are few that I didn't put in the guide also. I was wondering about this too: they've found high levels of mercury in the water supply at Maya cities and believe now it contributed to the eventual collapse: https://arstechnica.com/science/2020/06/mercury-and-algal-blooms-poisoned-maya-reservoirs-at-tikal/ https://arstechnica.com/science/2020/06/mercury-and-algal-bl...
  - yard2010 2y ago
    > “The drinking and cooking water for the Tikal rulers and their elite entourage almost certainly came from the Palace and Temple Reservoirs,” wrote Lentz and his colleagues. “As a result, the leading families of Tikal likely were fed foods laced with mercury at every meal.” This makes me think: what if today's rulers are being poisoned by something making them act like idiots?
    - lukehollis 2y ago
      Ha! that's the best theory yet
    - deepfriedchokes 2y ago
      It could be that there is something making our leaders mentally ill, or it could be that only the mentally ill think that they should be leaders.
nyanpasu64 2y ago
Were the tombs and other structures originally sealed in with no path to the outside world? Were there other rooms accessible for rituals without archaeologists having to excavate tunnels in the modern day?
- lukehollis 2y ago
  For the majority of the monuments that I worked on, they were ritually destroyed, buried, and built on top of -- with the Rosalila temple being the main exception. The tombs typically have some type of arch and the temple area and staircases are kind of built around or on top of them.
ks2048 2y ago
Very cool. Any other Maya sites in the pipeline to do?
- lukehollis 2y ago
  Yes, I 3d captured the murals at San Bartolo, and they're somewhere in the pipeline of being ready to be made public soon.
ReallyOldLurker 2y ago
Wow! That sure brings back memories. I've been there twice, 2011 & 2012. Congratulations. I'm very impressed.
- lukehollis 2y ago
  Thanks so much! Does it look very different / did you go in the tunnels?
  - ReallyOldLurker 2y ago
    I was allowed to go down two short tunnels, one led to part of the underground drainage (the end of it was blocked so I didn't get to look at the drainage itself). Overall it seems the same. From the top of the pyramids in the back, we could look at the remains of the palace area, but it was roped off and I was told that the government was gearing up for archeological work there.The guide I was with talked a lot about how precise the courts were leveled to drain rainwater away and how after all these centuries the drainage still works perfectly.
thisOtterBeGood 2y ago
Very nice. Small improvement idea: Move the camera along paths in such a way that it does not glitch through solid earth.
- lukehollis 2y ago
  Thanks, I always wonder if it'll be too slow for people to follow the whole pathway--this will definitely be fixed in the desktop version.
JSoet 2y ago
Fantastic work! Just a small suggestion, I didn't realize that you could free explore the entire area until coming back and reading the comments on this site, I realized you could look around and there was one point in the guides tour where it mentioned you can explore but at least for me I didn't realize you could explore everywhere (especially the tunnels afterwards) Maybe it's just that I'm on mobile, and when I went back I then saw the "free explore" button on the top... But maybe would be nice to add a couple prompts like you have at that one point which say something like "feel free to explore around the tunnels and then click next when you're ready to continue" or something (also for the ball court)...
- lukehollis 2y ago
  Thanks for letting me know! That makes good sense, and I did this in other tours. I'll see what I can do.
t_hinman_esq 2y ago
This is beyond cool, thank you for sharing!

462 points by lukehollis 2y ago

mmh0000 2y ago

I don't know which is cooler. The 3D scan itself or the 3D map in the browser. This is amazing. Thank you for sharing.

lukehollis 2y ago
Thanks for visiting! It was so many tunnels.. I feel bad that I don't build faster sometimes, but this took awhile.
- iwontberude 2y ago
  Get used to slowing down, it’s inevitable and you shouldn’t hold yourself to an unreasonable standard. Biology’s first principles make this clear.
  - lukehollis 2y ago
    It was specifically the time in the tunnels from 6:00 AM - noon every day that was an out-of-the-ordinary time and energy investment. It was necessary to be there, so I evaluated as "do things at dont scale."

23B1 2y ago

Luke I'm so happy to see you here on HN. What you and the Mused team are doing is incredible.

lukehollis 2y ago
Wow, thanks so much! I don't recognize your un, who is this? But thanks again!
- 23B1 2y ago
  I'm a nobody, but I've stumbled across your site before. Kudos and be sure to let the HN community know how we can help.

throwup238 2y ago

Very well done! I was pleasantly surprised how well this works on a phone. Did you take any scans after sections collapsed? Would love to hear more about what happened.

lukehollis 2y ago
Matterport's SDK is so good -- I'm so impressed with the details like mobile performance the more time I spend building with it. I did take some scans after the collapse! After we'd dug ourselves out and crawled out on our bellies, I went back with Polycam. The collapsed section we dug through was comparatively small, maybe 4-5 meters: Section 1: https://poly.cam/capture/4BB863F2-1CC3-46E3-8BDB-232EE3057BD3 https://poly.cam/capture/4BB863F2-1CC3-46E3-8BDB-232EE3057BD...? (you can see where we crawled out to the intersection here -- the whole intersection had ceiling collapse, but only the section we dug out through was fully covered). Section 2: https://poly.cam/capture/3C5BB7BD-5FC9-4C00-AE1C-84E0544C51CF https://poly.cam/capture/3C5BB7BD-5FC9-4C00-AE1C-84E0544C51C... We're just lucky it wasn't a rocky ceiling that fell, that would've been much worse. The team taking care of the tunnels is doing an amazing job with the resources they have, and they're continually backfilling tunnels now and maintaining the ones that are there. It took us about an hour to dig out. You can compare to the intersection in the matterport version in the same vicinity: https://my.matterport.com/show/?m=r5BR6K6Qxix&ss=338&sr=-.21,-.23 https://my.matterport.com/show/?m=r5BR6K6Qxix&ss=338&sr=-.21... I don't want to editorialize too much, but at that moment we were totally brothers--I was still early with Spanish, and the language, country, age differences fell away, and we dug ourselves out.

downboots 2y ago

The transitions are much smoother than Google street view

lukehollis 2y ago
Matterport works special magic on the transition between 360 images in their SDK. As far as I understand it, they render 360 cube camera onto the material of the mesh of the environment as you move so it looks like you're moving in the real mesh but only seeing the 360 image. I tried to approximate this myself in Three.js but didn't get anywhere near the quality or performance of their work. Homage.
nh2 2y ago
If you like smooth transitions, check my startup's: https://benaco.com/go/k4-green-hn-2024 https://benaco.com/go/k4-green-hn-2024
- lukehollis 2y ago
  These look great! What strategy did you use to do the transitions?
  - nh2 2y ago
    It works as you described: Texturing the mesh "live" as you move through it. It does use Three.js as a base, but needs custom shaders to make it 60 FPS.
    - lukehollis 2y ago
      Very cool.. bravo -- it looks so good

01HNNWZ0MV43FF 2y ago

That is so cool. Is it hard to avoid integrator error in long tunnels?

lukehollis 2y ago
It is so hard! The long tunnel sections were the worst, but thankfully most of them had multiple join points, like in the Temple 16 / Rosalila temple excavations.

oidar 2y ago

I love all these Maya inscriptions. I hope more are discovered (and hopefully some manuscripts) - the little we do have of Maya text is amazing. What are your top 3 things to tell people at parties that no little about Maya?

lukehollis 2y ago
I love the inscriptions too--the stela only get more meaningful the more you learn about them. But it's kind of like Egypt, the iconography is harder to understand because we inherited from a different culture. For me, the Maya have always been important because they're our history and our stories in the Americas (I'm from the US) -- more than the greco-roman mythology I grew up with. They grew corn and love ball games. Their stories are more directly our stories, and their struggles are our struggles. Not to be political, but they also kind of wiped themselves out by large scale environmental collapse, and the jungle is filled with their undiscovered monuments. There's still so much to learn. People really geek out on how much the Maya knew about astronomy too -- they shot archaeoastronomy docs twice while I was working on site. Richard Feynman even helped decipher Maya glyphs and writes about it in "Surely you're joking Mr Feynman". He gave a lecture also if the audio file can be checked out somehow: https://collections.archives.caltech.edu/repositories/2/accessions/2659 https://collections.archives.caltech.edu/repositories/2/acce...
- tonyg 2y ago
  Feynman was very interested in Maya writing, but made no useful contribution to its interpretation. Credit for that goes to Knorozov and many others (https://en.wikipedia.org/wiki/Maya_script#Decipherment); https://en.wikipedia.org/wiki/Maya_script#Decipherment); Feynman's approach followed Thompson's, which we know now to be incorrect.
  - lukehollis 2y ago
    Thanks for the correction!

cynicalpeace 2y ago

This reminds me of a recent Lex Fridman podcast with an expert in ancient American civilizations: https://www.youtube.com/watch?v=AzzE7GOvYz8 https://www.youtube.com/watch?v=AzzE7GOvYz8

voodooEntity 2y ago

The fact that people carved this tunnels with simple tools and their bare hands into the underground is so freaking amazing i cant find better words for it Edit: also very nice tool :)!

AStonesThrow 2y ago
> The fact that people carved this tunnels with simple tools and their bare hands I'm confused, mate: why and how would 21st-century professional archaeologists avoid using modern powered tools and techniques? That's absurd, dangerous, and not cost-effective.
- mxmilkiib 2y ago
  I think you misunderstood that comment a bit
  - AStonesThrow 2y ago
    I think the commenter misunderstood the article a bit. I was trying to give benefit of the doubt.

TheCleric 2y ago

This is great! Great job!

lukehollis 2y ago
Thanks!

everly 2y ago

Definitely one of the better implementations I've seen using Matterport's SDK, nice work. Did you use the Pro3 as the capture device? Before the collapse anyway!

lukehollis 2y ago
Thanks, and I was still on Pro 2 + BLK 360 unfortunately. Haha, thankfully all the cameras survived and made it home, just muddier.
- everly 2y ago
  Oh man, the BLK360 can be a frustrating (albeit incredible) device even in the best of conditions, let alone this. Glad to hear everything survived! I mostly use the Pro3 now but did a big chunk of this Georgia Tech scan with the BLK: https://my.matterport.com/show/?m=PB8FgAyyjHx https://my.matterport.com/show/?m=PB8FgAyyjHx
  - lukehollis 2y ago
    Haha, yeah I know what you mean. I had to do the exterior with the BLK for only a few hours each morning before it overheated. That's an impressive huge capture!

rendall 2y ago

Amazing. So inspiring!

lukehollis 2y ago
Thanks so much!

farhaven 2y ago

This is very cool! Can you share the technical background you've used for creating the 3D reconstruction? Like software packages, or algorithms used. Are we looking at the result of packages like OpenSfM here, or COLMAP?

lukehollis 2y ago
Onsite I used the Matterport capture app and Matterport Pro 2 and BLK 360. For the web version linked here, I built on top of the Matterport SDK with Three.js https://matterport.github.io/showcase-sdk/sdkbundle_home.html https://matterport.github.io/showcase-sdk/sdkbundle_home.htm... So in the virtual tour, you're seeing 360 imagery from the cameras and a lower resolution version of the 3d capture data, optimized for web. The lower res mesh from the scanner is transparent in first-person view mode so users get cursor effects on top of the 360 image. For film, PBS sent out a documentary crew, and they wanted me to render some footage of the full tunnel system, so I exported the e57 pointcloud data from Matterport and rendered the clips they needed in Unreal. It should be coming out soon with "In the Americas."
deleted 2y ago
[deleted]

renewiltord 2y ago

Does anyone know if there’s a simple solution to generating NeRFs from a continuous all directional camera (like a GoPro Max). It would be fun to make an explorable universe like that.

lukehollis 2y ago
You should be able to do this with nerfstudio: https://github.com/nerfstudio-project/nerfstudio/ https://github.com/nerfstudio-project/nerfstudio/ I've done it a few times, you can test 3d Gaussian Splatting also instead.
- renewiltord 2y ago
  Thank you! That's terrific.
- smusamashah 2y ago
  Hadn't seen this comment before. Why is this one not Guassian Splats or nerfs?

jofla_net 2y ago

This is great use of the technology. There should be scans of all our national monuments, world wonders, etc. So much better a use for the tech than just Redfin.

volk45 2y ago
Popping my comment cherry here! I’m a 3D artist that is currently encountering staunch resistance of generating 3D models from drone captured photogrammetry of historically protected sites in Pennsylvania, USA. I’ve had resistance from the state and county level in pursuing take off and landing permission at historical sites. Communicating my intentions of digital historic preservation with photogrammetry has been a difficult “sell”. I’m a licensed commercial remote pilot - however I need property owner permission to take off and land. Many sites are in state/county owned property in my area.
- lukehollis 2y ago
  Hey I'm really sorry! It's really hard. My photo permissions at Giza took two years to secure. My only advice is to keep showing up in person and hang in there--I feel for you!
  - volk45 2y ago
    That’s some incredible perseverance from you! In person is the right move though. Getting FaceTime in with groups or people who are part of the process does seem to make the best headway.
- seabass-labrax 2y ago
  Have you looked to see whether there is a local archaeology or social history society in your area that you could join? They will have individuals involved who are already used to dealing with property owners to arrange research projects, and you might be able to accompany them on the trips they organize. For reference, the archaeological society in my region serves around 400 square miles and typically organizes a low two-digit number of digs every year. There are also some other societies in the same region who focus on preserving and documenting recent history where excavation isn't required. Another idea: if you don't already have any formal education in history, you could study for some qualifications in the subject. It would probably do much to reassure landowners that you are not going to harm the sites in any way (although I struggle to think of a way you could do so with a UAV!) In any case, good luck; I'd love to see the models!

smusamashah 2y ago

This is great. I think you shared 3d scan of some other pyramid sometime ago here on HN. I think you should try processing this data through a Guassian Splatting software. I have no idea how many images Guassian Splats require to work well or the CPU/GPU requirements but I have seen very very cool Guassian Splatting demos on twitter where you can absolutely freely fly around the scene and view it from any angle.

lukehollis 2y ago
Hey, yeah that was me. I spent quite a bit of time last year using pre-existing scanner positions to train nerfs/splats and didn't get anything that was usable, unfortunately. I ended up shifting to Unreal for a higher graphics tier, so if you want to see the Great Pyramid of Giza interior in the highest quality level, you can here: https://mused.com/netherworld-ancient-egyptian-afterlife-simulator/ https://mused.com/netherworld-ancient-egyptian-afterlife-sim... For Unreal I used a few methods but mostly conventional photogrammetry incorporating the lidar. Ultimately, I'm hoping that downloading the file or some type of pixel streaming for web until the nerfs or splats -- or whatever follows them -- works out.
- ftrsprvln 2y ago
  Really appreciate the use of technology to make sites like these accessible to the world at large. Just wanted to share that I am in the middle of a very similar project with a high profile client & the workflow we settled on has loosely been Lidar scans -> Postshot -> Supersplat (web optimization) -> Babylon.js. Of course we have video/image fallbacks & an unreal pixel streaming version as well - but the web performance and results on a modern mobile device have been spectacular so far! So excited for the future of gaussian splatting :)
  - lukehollis 2y ago
    Wow, thanks for writing -- would love to see what you're building when you have a link to share! My emails in my profile or just will keep an eye out in general for this workflow.

hexnuts 2y ago

Is there any plans to support a WebXR interface in the future?

lukehollis 2y ago
Yes, these scans also work in WebXR using Matterport's default VR viewer -- I have a basic page setup at https://mused.com/vr/ https://mused.com/vr/ -- but I'll get the Copan tours added there.

programd 2y ago

I'm glad to hear you're working on getting an Unreal environment for these scans. I find the movement in the web version to be incredibly clunky. This really needs to have a game like environment to do it justice. In general we clearly have the technology to capture 4K-8K environments and turn them into very realistic virtual worlds. Is anybody even doing such work? For example capturing a neighborhood in San Francisco (or any city) as it looks in 2024 for historical reference? Seems like that should be a thing. I've seen high quality environmental scans, even way back in the Silicon Graphics days when they showed an amazing scan of the Sistine Chapel. But it seems to me all such scans wind up in some proprietary player format which was designed by somebody who never played a decent open world game like Fallout 4, Cyberpunk, Battlefield, Red Dead Redemption. I have yet to see a museum environmental scan which gets anywhere near the immersive quality of those games. This is not so much a criticism of such work - it's awsome! - but maybe more of a call to arms for game people to help out the scholars.

namibj 2y ago
I was working towards that aiming at the medieval city of Rothenburg o.d.T. in Germany. Unfortunately it's a lot of code writing to support rolling shutter cameras strapped to multicopters, where you capture video with short enough exposure to prevent blur. The 3D recovery has to respect the fact that the rows of the image are taken from different positions and angles, causing this up infiltrate basically the entire pipeline. And global shutter cameras are barely accessible. If there's some group with the man power and funding to actually pull this off, please get in touch, I would like to pick back up!
lukehollis 2y ago
You can download or test the Unreal version pixel streaming here: https://mused.com/netherworld-ancient-egyptian-afterlife-simulator/ https://mused.com/netherworld-ancient-egyptian-afterlife-sim... Or here's the trailer for the project in Unreal: https://www.youtube.com/watch?v=hlNgpG9X7mc https://www.youtube.com/watch?v=hlNgpG9X7mc I have a lot of work keeping up with games, it's true--games are expensive to build and aiming at photorealism art style continually looks dated quickly while stylized graphics, less so. I'm trying to fundraise to build this game currently, but it's a tough sell. Educational games don't do well on Steam, so right now, I'm just distributing through my website as I build. The small income this provides helps me contribute back to the modern Egyptian Egyptologists that are excavating and documenting their own culture though. The latest Game Science title, Black Myth Wukong, does an awesome job with 3d captures of Chinese monuments and bringing the mythology and history to life.

gerdesj 2y ago

Superb! I expect whoever coated the remains with that red cinnabar stuff died rather early, probably with tooth and hair loss and severe mental issues. Perhaps this fate was expected but given that "mad hatters" were a thing until fairly recently, people can be a bit strange when it comes to dealing with poisons. The guide notes point out that only the most sacred rituals involved this red mercurial stuff. I'm not surprised. It might be rare but rarer still will be people willing to deploy it unless that fate is considered a good way to go. That tour is a remarkable use of the technology.

lukehollis 2y ago
It's something we have to be careful of while working on site! We're really careful around the rooms that have mercury in them--there are few that I didn't put in the guide also. I was wondering about this too: they've found high levels of mercury in the water supply at Maya cities and believe now it contributed to the eventual collapse: https://arstechnica.com/science/2020/06/mercury-and-algal-blooms-poisoned-maya-reservoirs-at-tikal/ https://arstechnica.com/science/2020/06/mercury-and-algal-bl...
- yard2010 2y ago
  > “The drinking and cooking water for the Tikal rulers and their elite entourage almost certainly came from the Palace and Temple Reservoirs,” wrote Lentz and his colleagues. “As a result, the leading families of Tikal likely were fed foods laced with mercury at every meal.” This makes me think: what if today's rulers are being poisoned by something making them act like idiots?
  - lukehollis 2y ago
    Ha! that's the best theory yet
  - deepfriedchokes 2y ago
    It could be that there is something making our leaders mentally ill, or it could be that only the mentally ill think that they should be leaders.

nyanpasu64 2y ago

Were the tombs and other structures originally sealed in with no path to the outside world? Were there other rooms accessible for rituals without archaeologists having to excavate tunnels in the modern day?

lukehollis 2y ago
For the majority of the monuments that I worked on, they were ritually destroyed, buried, and built on top of -- with the Rosalila temple being the main exception. The tombs typically have some type of arch and the temple area and staircases are kind of built around or on top of them.

ks2048 2y ago

Very cool. Any other Maya sites in the pipeline to do?

lukehollis 2y ago
Yes, I 3d captured the murals at San Bartolo, and they're somewhere in the pipeline of being ready to be made public soon.

ReallyOldLurker 2y ago

Wow! That sure brings back memories. I've been there twice, 2011 & 2012. Congratulations. I'm very impressed.

lukehollis 2y ago
Thanks so much! Does it look very different / did you go in the tunnels?
- ReallyOldLurker 2y ago
  I was allowed to go down two short tunnels, one led to part of the underground drainage (the end of it was blocked so I didn't get to look at the drainage itself). Overall it seems the same. From the top of the pyramids in the back, we could look at the remains of the palace area, but it was roped off and I was told that the government was gearing up for archeological work there.The guide I was with talked a lot about how precise the courts were leveled to drain rainwater away and how after all these centuries the drainage still works perfectly.

thisOtterBeGood 2y ago

Very nice. Small improvement idea: Move the camera along paths in such a way that it does not glitch through solid earth.

lukehollis 2y ago
Thanks, I always wonder if it'll be too slow for people to follow the whole pathway--this will definitely be fixed in the desktop version.

JSoet 2y ago

Fantastic work! Just a small suggestion, I didn't realize that you could free explore the entire area until coming back and reading the comments on this site, I realized you could look around and there was one point in the guides tour where it mentioned you can explore but at least for me I didn't realize you could explore everywhere (especially the tunnels afterwards) Maybe it's just that I'm on mobile, and when I went back I then saw the "free explore" button on the top... But maybe would be nice to add a couple prompts like you have at that one point which say something like "feel free to explore around the tunnels and then click next when you're ready to continue" or something (also for the ball court)...

lukehollis 2y ago
Thanks for letting me know! That makes good sense, and I did this in other tours. I'll see what I can do.

t_hinman_esq 2y ago

This is beyond cool, thank you for sharing!