Describe your idea

The upcoming 0.8 update is set to bring a significant transformation to our AR Glasses, to the extent that I've entirely replaced the old system with a new one and rebranded them as Smart Glasses.

I'm initiating this issue request to establish a centralized place for discussing the forthcoming developments and desired features for these glasses.

Furthermore, to enhance the centralization of our Smart Glasses' future, I will compile a list of all presently open issues related to Smart Glasses/AR Goggles:

Features:

• IntelligenceModding/Advanced-Peripherals-Features#26, IntelligenceModding/Advanced-Peripherals-Features#50 More debug functions to retrieve more information about the player/the screen
• IntelligenceModding/Advanced-Peripherals-Features#52 Player Events
• IntelligenceModding/Advanced-Peripherals-Features#53 Enhanced rendering functions like polygons
• IntelligenceModding/Advanced-Peripherals-Features#57 3D Rendering
• IntelligenceModding/Advanced-Peripherals-Features#13 Hotkeys
• IntelligenceModding/Advanced-Peripherals-Features#17, IntelligenceModding/Advanced-Peripherals-Features#25 Kinetic Module (?)
• IntelligenceModding/Advanced-Peripherals-Features#58 A way to render GUIs (?)
• IntelligenceModding/Advanced-Peripherals-Features#3 A Full VR Mode (?)
• IntelligenceModding/Advanced-Peripherals-Features#59 A keyboard integrated as a module
• Night Vision Module

Bugs (Since the old system is gone, these bugs should also be gone):

• IntelligenceModding/Advanced-Peripherals-Features#44
• #307 Unexpected NPEs
• #379 Weird behavior with the coordinates
• IntelligenceModding/Advanced-Peripherals-Features#24 Transparency (More or less already fixed)

Features marked with (?) are just ideas which will not be 100% added to the game

When I finished a specific feature, I will post pictures and upload jars to test them

The progress for the 0.8 update is also "documented" via the commits on GitHub →Branch 0.8

About the coordinates system:

Will it be absolute (in world / MC coords)
or relative (either to the block the goggles are linked to, or the player that has the goggles)

Same question for the dimensions, at least for the AR part

small preview

The glasses with three peripherals and the overlay module:

About the coordinates system:

Will it be absolute (in world / MC coords) or relative (either to the block the goggles are linked to, or the player that has the goggles)

Same question for the dimensions, at least for the AR part

Discussable

To retrieve player coords? Absolute and relative, the dimension would be an extra property you can retrieve from the glasses.
To retrieve coords from blocks/objects in the world? Also, probably both, but I would make it configurable to disable absolute coordinates

Note that there isn't a block anymore. So all coordinates would be relative to the player's eye position
I am gonna post some pictures in a minute

I want the glasses can render 3D blocks if possible, so we can use computer to make 3D games. It maybe have to create another dimension. If the works are to heavy for you then nvm.

Yeah, that's such a thing I want to discuss when I start making the feature
How players think the endpoint should look like

That's a thing I will 99,9% add to the glasses. 🙂

For the 3D rendering, we would definitely need some way of rendering mass blocks instead of 1 by 1, though, the mention of 3D games by the person above, could maybe have a “VR mode” where it just is a whole different world and the computer is free to overwrite blocks and stuff, but that is definitely excessive.

I opened an issue for it IntelligenceModding/Advanced-Peripherals-Features#3

hey for the GUI peripheral idea, even without letting a whole custom GUI maker exist, A preset GUI based on some common vanilla and modded GUIs with some button events, and something like the inventory API would be a good way to atleast have a basic version, but a custom GUI would be killer.

Would also save me from having this janky thing I currently have set up in my world with ender chests mod.

will 1.18.2 have this new system?

@bmartin127
If I have the motivation and time to backport this, yeah
I guess I will backport this, but I need to see how much work this acutally is.

can't wait for smart glasses to be added :)

Finally got some time to work on the glasses
Got object syncing to the client done and basic rendering

(This is a YouTube video, you can click on it)

This is my current test script
It deletes the objects that were created before(from another script)
Creates two with some different sizes and colors
Waits a second and then changes the color and size of the objects for testing

The objects are always in sync with the client. If one was updated via a function, it syncs the changes to the client and displays the change without deleting the old object and creating a new one. Essentially preventing flickering.

test = peripheral.wrap("back")

test.clear()
sleep(1)
panelOne = test.createPanel("one", {maxX = 160, maxY = 160})
panelTwo = test.createPanel("two", {opacity = 0.3, x = 500, y = 500, maxY = 40, maxX = 40, color = 0xFF8448})

sleep(1)
panelOne.setColor(0x003c9c)
panelTwo.setMaxX(300)

Would be cool to get barebone version of goggles before 0.8, for sure it would ruin joy of full 0.8 release, but i would be happy even w/ only ability to draw basic shapes lol.
Anyway, good job keeping up the good work👍

Sure
I will try to publish a small preview of the documentation and a working 0.8 build
But note that I constantly change the api or add and remove features

You are trying to scare me with ability to draw my full base on my goggles. The only question is what happened to that tool that gave ability to convert "paint" images (.nfp) to cc:t compatible? Didnt find source code as documentation is quite old