Difference between revisions of "VLC Dev Projects"

From VideoLAN Wiki
Jump to navigation Jump to search
m (Fix link)
 
(39 intermediate revisions by 10 users not shown)
Line 1: Line 1:
This is a list of small independent improvements to {{VLC}} for which we are looking for interested developers, because we simply don't have enough time.  
+
This is a list of small independent improvements to VLC for which we are looking for interested developers, because we simply don't have enough time.
  
These do not require advanced knowledge of VLC internals but they can still vastly improve many parts of VLC  
+
These do not require advanced knowledge of VLC internals but they can still vastly improve many parts of VLC
  
 +
For each project, we list a contact person, who knows the subject best and who will be able to assist you if you are interested in working on these. We generally are very often present on irc.videolan.org, chan #videolan, so please don't hesitate to drop by or to send a mail if you are interested in a given problem (our mail adresses are generally <nick>@videolan.org).
  
'''For each project''', we list a '''contact''' person, who knows the subject best and who will be able to assist you if you are interested in working on these. We generally are very often present on irc.videolan.org, chan #videolan, so please don't hesitate to drop by or to send a mail if you are interested in a given problem (our mail adresses are generally &lt;nick&gt;@videolan.org).
+
We also have a number of "easy" bugs. You can check them out [http://trac.videolan.org/vlc/query?status=new&status=assigned&status=reopened&difficulty=easy&order=priority` here]
  
'''Be careful, some projects may be unrelated, or deprecated, because of fast evolving software! Ask before&nbsp;!'''
+
= Easy projects =
  
 +
== Video Filters ==
 +
You can do video filters for {{VLC}}.
  
= Easy projects  =
+
You can inspire yourself on this
 +
[http://movavi.com/enhancemovie/filters.html list of filters] from a commercial product.
  
These projects are junior projects, the most easy ones to do, that require minimum knowledge of VLC.  
+
You can start the code [http://git.videolan.org/?p=vlc.git;a=tree;f=modules/video_filter here].
  
We also have a number of "easy" bugs. You can check them out [http://trac.videolan.org/vlc/query?status=new&status=assigned&status=reopened&difficulty=easy&order=priority` here]
+
== Subtitles improvements ==
 +
{{VLC}} does not support all the styles for a lot of subtitles type.
 +
Take a look at {{VLCSourceFile|modules/codec/subsdec.c}} to start coding.
  
== Code Janitorial  ==
+
= Network =  
  
It basically means to clean the code, it is helpful for all programmers. It helps to find bugs, and is a good way to learn about VLC's internals.
+
== RTCP support ==
  
It is covered in the [[Code Janitorial]] section.  
+
Our RTSP implementation (for broadcasting and video on demand) does not support the RTCP protocol. This is a must to have a real support for RTSP.
 +
Some work has already been started, but there is still much to do.
  
== Video Filters  ==
+
Contact: [[User:JPSaman|JPSaman]]
  
You can do video filters for {{VLC}}.
+
== Performant VLC streaming server ==
  
Cool ideas for video filters would be "old movie" or hqdn3d integration.
+
There are many bottlenecks currently limiting the performance and scalability of VLC as a streaming server:
 +
* The I/O blocks are linear, which implies lots of avoidable memory copying and dynamic memory allocations (particularly in the streaming output).
 +
* <s>mdate() (the timestamping function) is invoked in too many places to count them; but it is not a cheap operation on modern systems and should be avoided on the fast path. Ideally, a single thread would only need to call mdate() at most once per wake-up. In some case, mdate() is only used for debugging purpose which is really inefficient.</s>
 +
* The HTTP/RTSP core is single-threaded. This prevents scaling to SMP systems (which are the norm on server-side nowadays) properly. This also implies not very scalable I/O event polling. This also becomes problematic when one HTTP/RTSP client triggers a computationally intensive operation (such as establishing a TLS context if HTTP/SSL is used).
 +
* There are many dynamic memory allocations that could be avoided. Video filters and codecs are very careful about this, but the stream output plugins are not. In many case, a stack-based buffer can be used (stack buffer, has constant time fast lock-less allocation, and needs not be freed explicitly) instead.
 +
* <s>The messaging subsystems might be adding more locking (needs checking); this should be avoided particularly if the message is anyway ignord (e.g. debug message in non-debug mode).</s>
 +
* Interleaved RTP in RTSP is not supported.
  
You can start the code [http://git.videolan.org/?p=vlc.git;a=tree;f=modules/video_filter here] and you should read the [[Documentation:Hacker%27s_Guide/Video_Filters| hacker guide]].
+
Other improvements that would be particularly benefitial on the server side:
  
== Audio Filters ==
+
* Memory allocation failure are not always duly handled. In some cases, that could potentially be leveraged by a client to crash a VLC server by causing a very large allocation attempt.
 
+
* <s>Rewrite and revive the root wrapper to allow VLC to bind to the RTSP (554) port while not retaining root privileges.</s>
You can do audio filters for {{VLC}}.
 
 
 
A good idea would be to integrate [http://freeverb3.sourceforge.net/ freeverb3] or [http://www.ladspa.org/ LADSPA].
 
 
 
You can start the code [http://git.videolan.org/?p=vlc.git;a=tree;f=modules/audio_filter here].
 
 
 
== Lua Playlist parsers for websites  ==
 
 
 
VLC already supports youtube, dailymotion or other websites using the .lua scripts! Add new sites and new URLs support!
 
 
 
== Close bugs ==
 
 
 
Go to our bugtracker on http://trac.videolan.org/vlc/ and close a bug !
 
 
 
 
 
= Normal small projects  =
 
 
 
== Windows Media Center (WMC) IR Remote Control  ==
 
 
 
Basic Controls work (e.g. Volume, Mute etc), but I would like to get Play/Pause/Stop/DVD Menu etc to work!
 
 
 
Contact: [[User:Some1|some1]]
 
 
 
 
 
 
 
== DirectWrite support  ==
 
 
 
DirectWrite is another API introduced in Windows 7, used to write nicely shaped characters to screen. Someone should look into it, to see what could be done (like subtitles display).
 
 
 
Contact: [[User:Geal|Geal]]
 
 
 
 
 
 
 
== mozila and activex javascript api  ==
 
 
 
Add a callback to signal playlist state changes such as item started, item ended, next item started, last item ended, and so on.
 
 
 
Contact: [[User:Jpsaman|jpsaman]]
 
 
 
 
 
== Improved Podcast support  ==
 
 
 
Our current podcast support is very weak. We can read them, but that's all. We need a real infrastructure to handle them correctly. This will require some changes to the playlist code, so you will need to work closely with existing developers.
 
 
 
Contacts: [[User:Dionoea|Dionoea]] [[User:Zorglub|Zorglub]]
 
 
 
 
 
== WTV support ==
 
 
 
We would love to have a .wtv demuxer for the new wtv files from Windows Media center
 
 
 
Contact [[User:J-b|jb]]
 
 
 
 
 
== Improved ASX support  ==
 
 
 
ASX is a playlist format used by Microsoft stuff. We can read it but we could do much better. More information is available at https://trac.videolan.org/vlc/ticket/20
 
 
 
Contact: [[User:Dnumgis|Dnumgis]]
 
 
 
 
 
== Hint MP4/MOV Files ==
 
 
 
Add video and audio hint tracks as the output file is muxed. Resulting files can be streamed from RTSP server with trickplay, like DSS/QTSS. Probably requires use of GPAC libraries.
 
 
 
 
 
== LastFM radios  ==
 
 
 
http://gabistapler.de/blog/index.php?/archives/268-Play-last.fm-streams-without-the-player.html
 
 
 
Talk to dionoea or funman
 
 
 
 
 
== ASM optims ==
 
 
 
If you know how to code in x86 ASM, we have a few tasks for you
 
 
 
Contact [[User:J-b|jb]]
 
 
 
 
 
== DVD Audio ==
 
 
 
If you are a coder and fan of DVD-Audio, you can help to improve the support of DVD-Audio playback. Especially decryption.
 
 
 
Contact [[User:J-b|jb]]
 
 
 
 
 
== Performant VLC streaming server  ==
 
 
 
There are many bottlenecks currently limiting the performance and scalability of VLC as a streaming server:
 
 
 
 
 
*The I/O blocks are linear, which implies lots of avoidable memory copying and dynamic memory allocations (particularly in the streaming output).
 
*mdate() (the timestamping function) is invoked in too many places to count them; but it is not a cheap operation on modern systems and should be avoided on the fast path. Ideally, a single thread would only need to call mdate() at most once per wake-up. In some case, mdate() is only used for debugging purpose which is really inefficient.
 
*The HTTP/RTSP core is single-threaded. This prevents scaling to SMP systems (which are the norm on server-side nowadays) properly. This also implies not very scalable I/O event polling. Finally, this gets problematic if one HTTP/RTSP client triggers a computationally intensive operation (such as establishing a TLS context if HTTP/SSL is used).
 
*There are many dynamic memory allocations that could be avoided. Video filters and codecs are very careful about this, but the stream output plugins are not. In many case, a stack-based buffer can be used (stack buffer, has constant time fast lock-less allocation, and needs not be freed explicitly) instead.
 
*The messaging subsystems might be adding more locking (needs checking); this should be avoided particularly if the message is anyway ignord (e.g. debug message in non-debug mode).
 
 
 
Other improvements that would be particularly benefitial on the server side:
 
 
 
*Memory allocation failure are not always duly handled. In some cases, that could potentially be leveraged by a client to crash a VLC server by causing a very large allocation attempt.  
 
*Rewrite and revive the root wrapper to allow VLC to bind to the RTSP (554) port while not retaining root privileges.
 
  
 
Contact: [[User:Courmisch|Courmisch]]
 
Contact: [[User:Courmisch|Courmisch]]
  
 +
= Inputs =
  
== VideoLAN Subtitle Editor ==
+
== DVB support for Windows ==
 
 
The "VideoLAN Subtitle Editor" is runs on any OS that is supported by [[Libvlc]].
 
 
 
Features:
 
* Qt4 Interface
 
* Media playback based on [[Libvlc]]
 
* Multiple OS support (Linux, MacOS X, Windows, *BSD, ...)
 
* Internationalisation of subtitles
 
* Exporting to many subtitle formats (.srt, .ssa/.ass, .sub, .srt, .ssf, ...).
 
 
 
Examples of subtile editors:
 
* Subtitle Editor http://home.gna.org/subtitleeditor/
 
* Open Subtitle Editor http://opensubtitleed.sourceforge.net/
 
* Subtile formats: http://en.wikipedia.org/wiki/Subtitles
 
 
 
Contact: [[User:jpsaman|jpsaman]]
 
 
 
= Finished projects  =
 
 
 
== Audioscrobbler ==
 
 
 
An [http://www.audioscrobbler.net/ Audioscrobbler] VLC Plug-in for the social music network [http://www.last.fm Last.Fm]<br>
 
 
 
Plugin is finished, now part of vlc 0.9.0 (development version). Done by [[User:Funman|funman]]
 
 
 
== DVB support for Windows / BDA Drivers  ==
 
 
 
DVB is the norm for&nbsp;:
 
 
 
*Digital Terrestrial TV (aka DVB-T)
 
*Digital Cable TV (aka DVB-C)
 
*Digital Satellite TV (aka DVB-S)
 
 
 
Several DVB input cards exist. We support these on Linux, but not on Windows. For Windows, we need to support so-called BDA drivers.
 
 
 
The problem is that we don't have both the time and the required hardware on Windows comps.
 
 
 
This project is probably not terribly complex, but you need the hardware.
 
 
 
Plugin is done and availabe in the current Git version. Code by kenS
 
 
 
== DBus Integration  ==
 
 
 
[[DBus]] is a communication mechanism for Linux (mainly).
 
 
 
We would like VLC to be able to use it so that other programs can interact with vlc (start/stop, know what is being played, ...)
 
 
 
Work is well advanced, see [[DBus]], by funman and Mr_Mirsal
 
 
 
Contact: [[User:Xtophe|Xtophe]], [[User:Funman|funman]]
 
 
 
== V4L2 support  ==
 
 
 
VLC currently has a pvr module and a v4l (video for linux) module. However
 
 
 
*some cards are only supported in the new v4l2 API
 
*The linux kernel will soon drop v4l support
 
 
 
So if someone could update VLC's current modules to work with V4L2 and the new ivtv api, this would be a welcome addition. This is not a very difficult project, but you will need to have the hardware to test against. The code has been began, so it should not be too difficult.
 
 
 
Plugin is done and available in the current Git version. Code by Richard Hosking, [[User:Dionoea|dionoea]] and Dennis Lou.
 
 
 
== RTCP support  ==
 
  
Our RTSP implementation (for broadcasting and video on demand) does not support the RTCP protocol. This is a must to have a real support for RTSP. Some work has already been started, but there is still much to do.
+
DVB is the norm for :
 +
* Digital Terrestrial TV (aka DVB-T)
 +
* Digital Cable TV (aka DVB-C)
 +
* Digital Satellite TV (aka DVB-S)
  
Contact: [[User:JPSaman|JPSaman]]
+
Several DVB input cards exist. We support these on Linux, but not on Windows. For Windows, we need to support so-called BDA drivers.
  
== Windows port  ==
+
The problem is that we don't have both the time and the required hardware on Windows comps.
  
Finish port libcddb and libcdio for Windows.  
+
This project is probably not terribly complex, but you need the hardware.
 +
Someone has already began it on the forum, so start from there.
  
Port libzvbi for Windows
+
== V4L2 support ==
  
Contact [[User:J-b|jb]]
+
VLC currently has a pvr module and a v4l (video for linux) module.
 +
However
 +
* some cards are only supported in the new v4l2 API
 +
* The linux kernel will soon drop v4l support
  
== Improvements to the X11 video output  ==
+
So if someone could update VLC's current modules to work with V4L2 and the new ivtv api, this would be a welcome addition.
 +
This is not a very difficult project, but you will need to have the hardware to test against.
 +
The code has been began, so it should not be too difficult.
  
Fullscreen support to improve .
+
= Video =
  
[[Category:Coding]] [[Category:Activities]]
+
== DirectX 9 video output ==
  
== Subtitles improvements ==
+
DirectX 9 features some improvements that we could use in our video output
  
{{VLC}} does not support all the styles for a lot of subtitles type. Take a look at [http://trac.videolan.org/vlc/browser/trunk/modules/codec/subtitles/subsdec.c here] to start coding.
+
== Improvements to the X11 video output ==
  
Contact bitmap
+
Fullscreen support to improve .
  
 +
= Interfaces =
  
== Direct2D video output  ==
+
== Streaming profiles ==  
  
Direct2D is a new API introduced in Windows 7. VLC could use a a Direct2D vout.
+
This is a big subject, that has barely started. Interested persons will need to work closely with existing developers to implement this.
 +
Not much information is available yet. The idea is to make streaming very easy, and yet powerful by using parametrable profiles. These could be used either by the graphical interfaces or through HTTP/command line interfaces
  
Contact: [[User:Geal|Geal]]
+
= Playlist =
  
== DirectX 9 video output  ==
+
== Improved Podcast support ==
  
DirectX 9 features some improvements that we could use in our video output
+
Our current podcast support is very weak. We can read them, but that's all. We need a real infrastructure to handle them correctly. This will require some changes to the playlist code, so you will need to work closely with existing developers.
  
Contact: [[User:Geal|Geal]]
+
== Improved ASX support ==
  
== Pixel shaders in OpenGL video output  ==
+
ASX is a playlist format used by Microsoft stuff. We can read it but we could do much better. More information is available at
 +
https://trac.videolan.org/vlc/ticket/20
  
It would be nice to have a small proof of concept video output which takes care of chroma conversion using pixel shaders.
+
== Disc probing ==
  
Contact: [[User:Dionoea|dionoea]]
+
We currently have some miscellaneous code to detect discs (DVDs, Audio CDs, ...) but it's a bit scattered and it could be used much better in the playlist.
  
 +
== Live folders ==
  
== Interaction with online services ==
+
Some programs support so-called live folders. You add a folder to the playlist, and if the files in the folder are changed, the changes are copied to the playlist.
Hello, I would like to present their concept idea, it involves interaction with online services and some changes in the user interface of VLC Media Player.  
 
  
On the first tab (Movie) is very straightforward, a user inserts a DVD, HD-DVD or BlyRay selects the desired slot and begin viewing.
+
Having this would of course be great :)
In the future it will be possible to implement view of the disk image.
 
  
The second tab (Video), makes it possible to watch media files directly from the HDD.
+
It might require some work to be able to do this in Linux, Windows and OS X, but the current developers will of course be able to help on these.
Setting up a profile can be all sorted by category (Films, TV shows, etc.), the category of Films on (Action, Horror, Camedy), the category of TV show on (Lost, House M. D, X-Files), etc.
 
After watching a movie or TV show, you can not closing VLC media player immediately to share impressions with your friends on Twitter, MySpace, Facebook.  
 
  
The third tab (Music), provides an opportunity to listen to music as a straight line from the HDD.
+
= Misc =
Similar to the previous tab, everything can be sorted into categories (Hip-Hop, R'n'B, Dance, Rock).
 
  
Another idea is to tab Online TV, where you can make a small internet browser tied to popular online Servas (YouTube) and send links to interesting videos to friends directly from the VLC Player.
+
== DBus Integration ==
  
Contact: [[User_talk:Jack.LJ|Jack.LJ]]
+
[[DBus]] is a communication mechanism for Linux (mainly).
  
=Discussions on projects=
+
We would like VLC to be able to use it so that other programs can interact with vlc (start/stop, know what is being played, ...)
  
==Proposals==
+
Work is well advanced, see [[DBus]]
  
* [[Newplaylist|Playlist improvement]]<br/>
+
[[Category:Coding]]
* [[Newsoundslider|Soundslider improvement]]
+
[[Category:Development]]

Latest revision as of 09:57, 16 February 2019

This is a list of small independent improvements to VLC for which we are looking for interested developers, because we simply don't have enough time.

These do not require advanced knowledge of VLC internals but they can still vastly improve many parts of VLC

For each project, we list a contact person, who knows the subject best and who will be able to assist you if you are interested in working on these. We generally are very often present on irc.videolan.org, chan #videolan, so please don't hesitate to drop by or to send a mail if you are interested in a given problem (our mail adresses are generally <nick>@videolan.org).

We also have a number of "easy" bugs. You can check them out here

Easy projects

Video Filters

You can do video filters for VLC media player.

You can inspire yourself on this list of filters from a commercial product.

You can start the code here.

Subtitles improvements

VLC media player does not support all the styles for a lot of subtitles type. Take a look at modules/codec/subsdec.c to start coding.

Network

RTCP support

Our RTSP implementation (for broadcasting and video on demand) does not support the RTCP protocol. This is a must to have a real support for RTSP. Some work has already been started, but there is still much to do.

Contact: JPSaman

Performant VLC streaming server

There are many bottlenecks currently limiting the performance and scalability of VLC as a streaming server:

  • The I/O blocks are linear, which implies lots of avoidable memory copying and dynamic memory allocations (particularly in the streaming output).
  • mdate() (the timestamping function) is invoked in too many places to count them; but it is not a cheap operation on modern systems and should be avoided on the fast path. Ideally, a single thread would only need to call mdate() at most once per wake-up. In some case, mdate() is only used for debugging purpose which is really inefficient.
  • The HTTP/RTSP core is single-threaded. This prevents scaling to SMP systems (which are the norm on server-side nowadays) properly. This also implies not very scalable I/O event polling. This also becomes problematic when one HTTP/RTSP client triggers a computationally intensive operation (such as establishing a TLS context if HTTP/SSL is used).
  • There are many dynamic memory allocations that could be avoided. Video filters and codecs are very careful about this, but the stream output plugins are not. In many case, a stack-based buffer can be used (stack buffer, has constant time fast lock-less allocation, and needs not be freed explicitly) instead.
  • The messaging subsystems might be adding more locking (needs checking); this should be avoided particularly if the message is anyway ignord (e.g. debug message in non-debug mode).
  • Interleaved RTP in RTSP is not supported.

Other improvements that would be particularly benefitial on the server side:

  • Memory allocation failure are not always duly handled. In some cases, that could potentially be leveraged by a client to crash a VLC server by causing a very large allocation attempt.
  • Rewrite and revive the root wrapper to allow VLC to bind to the RTSP (554) port while not retaining root privileges.

Contact: Courmisch

Inputs

DVB support for Windows

DVB is the norm for :

  • Digital Terrestrial TV (aka DVB-T)
  • Digital Cable TV (aka DVB-C)
  • Digital Satellite TV (aka DVB-S)

Several DVB input cards exist. We support these on Linux, but not on Windows. For Windows, we need to support so-called BDA drivers.

The problem is that we don't have both the time and the required hardware on Windows comps.

This project is probably not terribly complex, but you need the hardware. Someone has already began it on the forum, so start from there.

V4L2 support

VLC currently has a pvr module and a v4l (video for linux) module. However

  • some cards are only supported in the new v4l2 API
  • The linux kernel will soon drop v4l support

So if someone could update VLC's current modules to work with V4L2 and the new ivtv api, this would be a welcome addition. This is not a very difficult project, but you will need to have the hardware to test against. The code has been began, so it should not be too difficult.

Video

DirectX 9 video output

DirectX 9 features some improvements that we could use in our video output

Improvements to the X11 video output

Fullscreen support to improve .

Interfaces

Streaming profiles

This is a big subject, that has barely started. Interested persons will need to work closely with existing developers to implement this. Not much information is available yet. The idea is to make streaming very easy, and yet powerful by using parametrable profiles. These could be used either by the graphical interfaces or through HTTP/command line interfaces

Playlist

Improved Podcast support

Our current podcast support is very weak. We can read them, but that's all. We need a real infrastructure to handle them correctly. This will require some changes to the playlist code, so you will need to work closely with existing developers.

Improved ASX support

ASX is a playlist format used by Microsoft stuff. We can read it but we could do much better. More information is available at https://trac.videolan.org/vlc/ticket/20

Disc probing

We currently have some miscellaneous code to detect discs (DVDs, Audio CDs, ...) but it's a bit scattered and it could be used much better in the playlist.

Live folders

Some programs support so-called live folders. You add a folder to the playlist, and if the files in the folder are changed, the changes are copied to the playlist.

Having this would of course be great :)

It might require some work to be able to do this in Linux, Windows and OS X, but the current developers will of course be able to help on these.

Misc

DBus Integration

DBus is a communication mechanism for Linux (mainly).

We would like VLC to be able to use it so that other programs can interact with vlc (start/stop, know what is being played, ...)

Work is well advanced, see DBus