These days many surgeries are performed with a minimally-invasive approach, also known as medical endoscopy or keyhole-surgery. There are several special areas of medical endoscopy, the most frequent ones are arthroscopy (operations performed on joints), colonoscopy (procedures in the colon), and laparoscopy (operations in the abdomen). The endoscope is equipped with a light source, some fiber optics, and a high-resolution video camera, whose images are transmitted to a large display in the operation room. The images on this display are used by the operating endoscopists to control the endoscope and supervise actions performed with the operation instruments. Surgeons nowadays also record the real-time images of the endoscope as digital videos, stored as video segments for the most important parts of the surgery, or as a full video for the whole surgery, due to several reasons. In the EndoVIP2 project we focus on processing of these videos, performing video content analysis to detect relevant content, developing efficient storage methods for these videos, and providing efficient content search for that particular video data.