9 ms·

How are pointers implemented in a language that doesn't support them?

by JavaOnlyGuy 4y ago

chrisseaton 4y ago
A class wrapping a long value with the pointer address in it.
- MaxBarraclough 4y ago
  How is the C memory modelled? One big Java array, or are there multiple data-structures? For instance, what happens when you call a function-pointer?
  - aardvark179 4y ago
    It can be done in a few different ways. Native memory can be managed as plain native memory (under the hood you can use Unsafe to access that memory) but the real advantage is that pointers to many objects can be kept as managed pointers and not converted to a native value most of the time. For example Ruby C extensions often use VALUEs to refer to Ruby objects which are normally tagged pointers. In TruffleRuby we use ValueWrapper objects to represent these, and maintain a fast map between native values and these objects when necessary.
  - chrisseaton 4y ago
    > How is the C memory modelled? Using a combination of native memory and JVM managed memory, depending on what the memory is needed for. > For instance, what happens when you call a function-pointer? This is a good example - because TruffleC can inline-cache a function-pointer, inlining the called function! All this is in the linked paper, of course.
- sitkack 4y ago
  Ha! Your paper is a "highly influential citation" https://www.semanticscholar.org/paper/TruffleC%3A-dynamic-execution-of-C-on-a-Java-virtual-Grimmer-Rigger/e13f1d64f636de03f352965b21d0334acc4f132b?sort=is-influential https://www.semanticscholar.org/paper/TruffleC%3A-dynamic-ex...
  - chrisseaton 4y ago
    The side-bar says 'highly influential' but the badge lower down says 'highly influenced' which sounds like a bad thing doesn't it?
    - forgotpwd16 4y ago
      Probably meant as "[this paper has] highly influenced [citing paper]".
      - sitkack 4y ago
        Semantic Scholar is calling out when it thinks the researchers were using drugs.
quietbritishjim 4y ago
I guess a really brute force way would be to have a huge dictionary mapping from "memory address" (really just an arbitrary number) to JVM object. malloc() would add to the dictionary and free() would remove an entry. Pointer dereference would look up in it but would need to be able to find the nearest lower entry (for when you have an array and dereference an entry in it, or use a pointer to a field in a struct). I would hope that there's a much more efficient way to do it, this idea is just evidence that it could be done in principle. But I don't see what that more efficient way would be. You certainly need to keep a secret reference to each JVM object somehow because C doesn't require you to keep any pointer to an object e.g. intptr_t x = (intptr_t)malloc(sizeof(int)); *(int*)x = 99; bool did_subtract_50 = false; if (x > 50) { did_subtract_50 = true; x -= 50; } // Now there is no pointer or even integer that contains the address // ... later ... // Retrieve the address and use and free it int* y = (int*)(x + 50 * did_subtract_50); printf("value: %d\n", *y); free(y);
deleted 4y ago
[deleted]
suprjami 4y ago
I don't think this is how it works. The JVM is a specification which describes a pretend computer and its instruction set. This TruffleC doesn't translate C to Java and run a Java program. This compiles C to bytecode which operates on the JVM. Whatever Java does or doesn't support is irrelevant to this compiler. TruffleC has nothing to do with the Java programming language at all. Just like you can compile C and get a memory address of a stack or heap location on any physical computer supported by a C compiler, likewise you can compile C with TruffleC and get a memory address within the stack or heap of the pretend computer called the JVM. This must be how it works, unless the JVM itself has no concept of memory addresses, which seems very unlikely to me. Let me know if I am wrong?
- dzaima 4y ago
  the JVM bytecode does not have any memory address type. Just various width integers & floats, and references to managed heap objects. Arbitrary pointers would have to be done with 'long's one way or another.
  - rschatz 4y ago
    You can still use pointers. It's a bit hidden, but there are things like `Unsafe.allocateMemory`, `Unsafe.getByte` and so on ;)
    - dzaima 4y ago
      right; at which point the subset of jvm you're using is a subset of any other IR/VM, the 'j' in 'jvm' being only useful as an implementation/runtime.
      - chaosite 4y ago
        Sure, but don't discount all of the JIT optimizations that were implemented in the JVM and the huge number of engineer years invested in that particular implementation/runtime...
- chrisseaton 4y ago
samus 4y ago
Well-behaved usages of pointers according to the C standard can be implemented by whatever means fit best. Fat pointers with metadata about the destination and a huge block of memory for generic cases come to mind. The rest is undefined behavior where the runtime can just nuke the program, aka segfaulting.

How are pointers implemented in a language that doesn't support them?

chrisseaton 4y ago

A class wrapping a long value with the pointer address in it.

MaxBarraclough 4y ago
How is the C memory modelled? One big Java array, or are there multiple data-structures? For instance, what happens when you call a function-pointer?
- aardvark179 4y ago
  It can be done in a few different ways. Native memory can be managed as plain native memory (under the hood you can use Unsafe to access that memory) but the real advantage is that pointers to many objects can be kept as managed pointers and not converted to a native value most of the time. For example Ruby C extensions often use VALUEs to refer to Ruby objects which are normally tagged pointers. In TruffleRuby we use ValueWrapper objects to represent these, and maintain a fast map between native values and these objects when necessary.
- chrisseaton 4y ago
  > How is the C memory modelled? Using a combination of native memory and JVM managed memory, depending on what the memory is needed for. > For instance, what happens when you call a function-pointer? This is a good example - because TruffleC can inline-cache a function-pointer, inlining the called function! All this is in the linked paper, of course.
sitkack 4y ago
Ha! Your paper is a "highly influential citation" https://www.semanticscholar.org/paper/TruffleC%3A-dynamic-execution-of-C-on-a-Java-virtual-Grimmer-Rigger/e13f1d64f636de03f352965b21d0334acc4f132b?sort=is-influential https://www.semanticscholar.org/paper/TruffleC%3A-dynamic-ex...
- chrisseaton 4y ago
  The side-bar says 'highly influential' but the badge lower down says 'highly influenced' which sounds like a bad thing doesn't it?
  - forgotpwd16 4y ago
    Probably meant as "[this paper has] highly influenced [citing paper]".
    - sitkack 4y ago
      Semantic Scholar is calling out when it thinks the researchers were using drugs.

quietbritishjim 4y ago

I guess a really brute force way would be to have a huge dictionary mapping from "memory address" (really just an arbitrary number) to JVM object. malloc() would add to the dictionary and free() would remove an entry. Pointer dereference would look up in it but would need to be able to find the nearest lower entry (for when you have an array and dereference an entry in it, or use a pointer to a field in a struct). I would hope that there's a much more efficient way to do it, this idea is just evidence that it could be done in principle. But I don't see what that more efficient way would be. You certainly need to keep a secret reference to each JVM object somehow because C doesn't require you to keep any pointer to an object e.g. intptr_t x = (intptr_t)malloc(sizeof(int)); *(int*)x = 99; bool did_subtract_50 = false; if (x > 50) { did_subtract_50 = true; x -= 50; } // Now there is no pointer or even integer that contains the address // ... later ... // Retrieve the address and use and free it int* y = (int*)(x + 50 * did_subtract_50); printf("value: %d\n", *y); free(y);

deleted 4y ago

[deleted]

suprjami 4y ago

I don't think this is how it works. The JVM is a specification which describes a pretend computer and its instruction set. This TruffleC doesn't translate C to Java and run a Java program. This compiles C to bytecode which operates on the JVM. Whatever Java does or doesn't support is irrelevant to this compiler. TruffleC has nothing to do with the Java programming language at all. Just like you can compile C and get a memory address of a stack or heap location on any physical computer supported by a C compiler, likewise you can compile C with TruffleC and get a memory address within the stack or heap of the pretend computer called the JVM. This must be how it works, unless the JVM itself has no concept of memory addresses, which seems very unlikely to me. Let me know if I am wrong?

dzaima 4y ago
the JVM bytecode does not have any memory address type. Just various width integers & floats, and references to managed heap objects. Arbitrary pointers would have to be done with 'long's one way or another.
- rschatz 4y ago
  You can still use pointers. It's a bit hidden, but there are things like `Unsafe.allocateMemory`, `Unsafe.getByte` and so on ;)
  - dzaima 4y ago
    right; at which point the subset of jvm you're using is a subset of any other IR/VM, the 'j' in 'jvm' being only useful as an implementation/runtime.
    - chaosite 4y ago
      Sure, but don't discount all of the JIT optimizations that were implemented in the JVM and the huge number of engineer years invested in that particular implementation/runtime...
chrisseaton 4y ago

samus 4y ago

Well-behaved usages of pointers according to the C standard can be implemented by whatever means fit best. Fat pointers with metadata about the destination and a huge block of memory for generic cases come to mind. The rest is undefined behavior where the runtime can just nuke the program, aka segfaulting.