A couple ideas, are they doable?
A couple ideas, are they doable?
I had a couple ideas for an FPGA, specifically the DE-10 Nano primarily used as a MiSTer. The first idea is to use some kind of an analog to digital converter to digitize RGBs, RGBHV, YPBPR signals and use the FPGA to deinterlace, upscale, and output over HDMI, so the MiSTer can double as an OSSC-like device for use with other consoles.
Another idea I had was outputting video simultaneously over HDMI, and also over USB3.0 or ethernet so that the video could be imported into OBS or other streaming software without the use for a capture card, most of which add some level of noise, and a lot of costs for something that theoretically should be able to do it.
So the idea would be to create an FPGA device that can play old consoles complete lag-free, upscale and convert the video output of original hardware (such as that from a PS2, Dreamcast, etc), and work as its own integrated capture card for livestreaming purposes.
Can this be done? I am certain an ADC chip will be necessary, perhaps a purpose built I/O board to contain it and the video inputs. And the capture/sending video to PC aspect of it is all digital so shouldn't need a lot of external parts to get working?
Another idea I had was outputting video simultaneously over HDMI, and also over USB3.0 or ethernet so that the video could be imported into OBS or other streaming software without the use for a capture card, most of which add some level of noise, and a lot of costs for something that theoretically should be able to do it.
So the idea would be to create an FPGA device that can play old consoles complete lag-free, upscale and convert the video output of original hardware (such as that from a PS2, Dreamcast, etc), and work as its own integrated capture card for livestreaming purposes.
Can this be done? I am certain an ADC chip will be necessary, perhaps a purpose built I/O board to contain it and the video inputs. And the capture/sending video to PC aspect of it is all digital so shouldn't need a lot of external parts to get working?
Re: A couple ideas, are they doable?
Question about transforming the Mister into an OSSC has already been debated many times, doing so needs to reallocate currently used GPIO and add a new IOBoard with analog inputs, from there it’s better have another dedicated project than merge it into Mister.
Now about video over USB, in my understanding of the Cyclone V architecture, the USB and network bus is connected to the HPS which the speed and bandwidth between the HPS and the FPGA within the Cyclone V won't be enough to compress video and sound feed from the FPGA scaler thru USB or network. Even if possible the result would worst be then HDMI who don't use lossy compression.
Now about video over USB, in my understanding of the Cyclone V architecture, the USB and network bus is connected to the HPS which the speed and bandwidth between the HPS and the FPGA within the Cyclone V won't be enough to compress video and sound feed from the FPGA scaler thru USB or network. Even if possible the result would worst be then HDMI who don't use lossy compression.
Re: A couple ideas, are they doable?
The first thing is basically the OSSC-Pro (they are using a cyclone V, at least they were last I looked). I know at one point they were talking about having a small add-on pcb for a de-10 to get some of the ossc-pro functionality. I have no idea where that project stands, nor if it would even be feasible to have both that and a 'normal' mister co-exist.
As far as video capture: you CAN get to the video memory via the linux side (see: https://github.com/alanswx/Screenshot_MiSTer)
I guess in theory you could use NDI to send it over the network, but there are real questions if you can sustain 60fps due to cpu and memory bandwidth issues. There's also no access to sound that I know of.
Probably not practically doable
As far as video capture: you CAN get to the video memory via the linux side (see: https://github.com/alanswx/Screenshot_MiSTer)
I guess in theory you could use NDI to send it over the network, but there are real questions if you can sustain 60fps due to cpu and memory bandwidth issues. There's also no access to sound that I know of.
Probably not practically doable
Re: A couple ideas, are they doable?
There’s another thread like this somewhere where there was a link to a github project where someone had already made an OSSC like thing with the DE10 nano. Not at all related to mister, it is its own thing.
-
- Posts: 56
- Joined: Tue Oct 27, 2020 4:52 pm
- Has thanked: 69 times
- Been thanked: 11 times
Re: A couple ideas, are they doable?
It’s not fpga, but rgbtohdmi makes use of a raspberry pi and cpld to capture digital signals inside a machine before the d2a stage, and it works with up to 12 bit colour (4096 colours, as in the Amiga)
That project is on GitHub and might give some good hints too?
That project is on GitHub and might give some good hints too?
- Newsdee
- Top Contributor
- Posts: 873
- Joined: Mon May 25, 2020 1:07 am
- Has thanked: 104 times
- Been thanked: 239 times
Re: A couple ideas, are they doable?
I don't see the point other than trying to save a few bucks. An independent (and dedicated) capture device is really worth it to reduce a lot of hassle.
My device comes up as a camera on Windows so I can easily capture, stream, or use it in Skype/Zoom calls.
My device comes up as a camera on Windows so I can easily capture, stream, or use it in Skype/Zoom calls.
- Sorgelig
- Site Admin
- Posts: 890
- Joined: Thu May 21, 2020 9:49 pm
- Has thanked: 2 times
- Been thanked: 214 times
Re: A couple ideas, are they doable?
OSSC-like is possible but it doesn't have to live in the same physical de10-nano as MiSTer. You always can buy second de10-nano for that purpose and create a scaler around it. As mentioned above, it will require add-on board to digitize analog video.
With digital I/O board the second 40pin connector is basically unused which gives opportunity to use digitizer board on that (at least till MiSTer will occupy it) and use the same de10-nano for MiSTer and scaler.
With digital I/O board the second 40pin connector is basically unused which gives opportunity to use digitizer board on that (at least till MiSTer will occupy it) and use the same de10-nano for MiSTer and scaler.
- bazza_12
- Top Contributor
- Posts: 443
- Joined: Sun May 24, 2020 7:49 pm
- Location: Yorkshire, UK
- Has thanked: 263 times
- Been thanked: 121 times
Re: A couple ideas, are they doable?
oOo have you something in mind?
The music is reversible but time is not. Turn back. Turn back
- Sorgelig
- Site Admin
- Posts: 890
- Joined: Thu May 21, 2020 9:49 pm
- Has thanked: 2 times
- Been thanked: 214 times