Search

Multi-screen service is a service that consumes more than one media in a number of terminals simultaneously or discriminately. This multi-screen service has become useful due to distribute of smart TV and terminals. Also, in case of hybrid broadcasting environment that is convergence of broadcasting and communication environment, it is able to provide various user experience through contents consumed by multiple screens. In hybrid broadcasting environment, scene composition technology can be used as an element technology for multi-screen service. Using scene composition technology, multiple media can be consumed complexly through the specified presentation time and space. Thus, multi-screen service based on the scene composition technology can provide spatial and temporal control and consumption of multiple media by linkage between the terminals. However, existing scene composition technologies are not able to use easily in hybrid broadcasting because of applicable environmental constraints, the difficulty in applying the various terminal and complexity. For this problems, HTML5 can be considered. HTML5 is expected to be applied in various smart terminals commonly, and provides consumption of diverse media. So, in this paper, it proposes the scene composition and multi-screen service technology based on HTML5 that is expected be used in various smart terminals providing hybrid broadcasting environment. For this, it includes the introduction in terms of HTML5 and multi-screen service, the method of providing information related with scene composition and multi-screen service through the extention of elements and attributes in HTML5, media signaling between terminals and the method of synchronization. In addition, the proposed scene composition and multi-screen service technology based on HTML5 was verified through the implementation and experiment.

Various methods are used to provide three-dimensional television (3DTV) services over a terrestrial broadcasting network. However, these services cannot provide high-quality 3D content to consumers. It is because current terrestrial broadcast networks are allocated with limited bandwidths to transmit 3D content while 3D content requires larger bandwidth compared to that of 2D content. To overcome this limitation, this paper proposes a hybrid 3DTV broadcasting system, which utilizes both a terrestrial broadcast network and a broadband network. In the proposed system, two elementary streams of left and right views for a stereoscopic video service are transmitted over a terrestrial broadcasting network and a broadband network, respectively. In addition, the proposed system suggests a new mechanism for synchronization between these two elementary streams. The proposed scheme can provide high-quality 3DTV service regardless of bandwidth of the terrestrial broadcast network while maintaining backward compatibility with a 2D DTV broadcasting service.

Hybrid broadcasting environment is convergence of broadcasting and communication environment. In hybrid broadcasting environment, a number of media can be delivered using both broadcasting channel and other network unlike traditional broadcast environment that is able to deliver a couple of media by the limited bandwidth. Now, starting with smart TV, hybrid broadcasting environment combining broadcasting channel and IP network is established, and a variety of services are appearing. Moreover, the services using hybrid broadcasting environment are expected to appear soon for the other smart terminals such as smart phone and tablet PC. Scene composition is one of the methods that can consume effectively a number of media delivered from hybrid broadcasting environment. Using scene composition, multiple media can be consumed through the specified presentation time and space. Therefore, in this paper, it proposes the scene composition technology that is suitable for hybrid broadcasting environment and smart terminals. However, the spatial composition and temporal composition of media using script language and style language of HTML5 might increase the complexity of processing, and cause limitation of avaliable terminals. Also, a document of HTML5 can describe only one scene. By these reason, the proposed scene composition technology extends HTML5 in order to provide the spatial and temporal composition of media and description of multiple scene through markup language. In addition, it includes the extension of HTML5 in terms of utilization in hybrid broadcasting environment. For this proposal, this paper describes the technology of HTML5 and proposed scene composition. Also, it verifies the scene composition with both implementations and experiments.

Richmedia Service means that interactive media service can provide view with various multimedia elements(such as Video, Audio, Text) at same time. Various Multimedia elements can be serviced by Scene Description technology standards like BIFS(Binary Format for Scenes) and LASeR(Light Application Scene Representation). By providing Scene Component information, richmedia service is available to various multimedia services. so users is available to personalized services fitting temporal and spatial options. In conventional technology, when the scene is changed by user or service, mobile deletes the scene of configuration information and makes new scene of configuration information. this is a very inefficient way. In this paper, Propoesed that by using DOM(Document Object Model) method, to pass only the dynamic configuration part, changes scene method.

This paper proposes a new terrestrial 3DTV broadcasting standard specification based on synchronization with non-real-time contents in order to overcome quality limitations of the current 3DTV services that are arisen from the limited bandwidth of the legacy broadcasting channel. In the services using the proposed specification, one view sequence of a stereoscopic video content is delivered as a non-real-time content in idle time, and the other view sequence is transmitted in real time broadcasting signal, thereafter two sequences are synchronized in a receiver for display. Thus, it is possible to provide higher-quality stereoscopic video content services than the current 3DTV services. In order to realize these services, a new mechanism is required which enables synchronization between the data that are from different transmission media and time. Therefore, this paper suggests a solution by multiplexing the synchronization signals of non-real-time contents into broadcasting signals with real-time streams together. This solution can provide a accurate synchronization mechanism by minimum updates of legacy broadcasting systems while maintaining compatibility with legacy services.

Recently, 3D stereoscopic video and HTTP adaptive streaming technologies have received a lot of attention from relevant industrial fields and markets in terms of multimedia contents and delivery services, respectively. It is expected that promising and marketable service models can be created by means of these noticeable two technologies. However, current standard specifications do not provide a method for organized connection between those two technologies. 3D stereoscopic video services are weighted in broadcasting and storage services that are only available under environments in which the network bandwidth is guaranteed or free. Also, HTTP adaptive streaming technologies only provide plain 3D service methods that are dependent on particular Codec. Therefore, this paper proposes 3D video delivery format for HTTP adaptive streaming service which enables stable and seamless display for various stereoscopic video sequences over internet networks. The proposed technology is designed on the basis of Stereoscopic Video Application Format which is a service-oriented standard specification for storing stereoscopic video sequences. Also, this delivery format is directly applicable over DASH that is the representative standard technology for HTTP adaptive streaming services. The delivery format proposed in this paper has been submitted to MPEG and it has been accepted as a working draft, thus it expected to pave the way for practical industrialization in relevant fields from now on.

Recently, many consumer electronics manufacturers have produced 3D devices such as 3DTVs and 3D monitors as interests in a stereoscopic video service are getting increased. However, most of 3D services are focused on local storage or bandwidth guaranteed service since 3D stereoscopic video service require bandwidth more stable and larger. This property causes difficulties in seamless stereoscopic video streaming services under IP based open network environment that cannot guarantee quality of services. In order to achieve a seamless video streaming service the international standard organization MPEG (Moving Pictures Experts Group) has developed the adaptive HTTP streaming technology called as DASH (Dynamic Adaptive Streaming over HTTP). However, the DASH doesn`t have obvious scheme which can express the two elementary video streams based service-compatible stereoscopic contents in one segment. Therefore, this paper proposes a scheme of efficient 3D adaptive streaming service based on the DASH, which covers not only frame-packing stereoscopic contents but also service-compatible ones. The 3D adaptive HTTP streaming scheme introduced in this paper is able to provide 3D contents with various qualities to user and also has benefit that single 3D content can be applied to a variety of devices.

Stereoscopic video for 3DTV service is emerging as a main content of the Post-HD age in the multimedia industry, and also it starts a ripple effect to build infrastructure for 3DTV service throughout the related industries such as creating contents, consumer electronics and the broadcasting. Thus, "Technical Specification of Stereoscopic Video over MPEG-2 TS for 3DTV Service" for providing a standard for 3DTV broadcasting transmitter and receiver interface is under development by the 3DTV WG8061 in ITA, Korea. This paper provides verification of the functionalities, problems and future work of the above specification with designed test-bed. Through making a test bed, this paper try to verify not only the functionality of standard but also backward compatible for the present technology and abstract problems to would be reviewed and supplemented.

This paper proposes a signaling and multiplexing mechanism in service-compatible 3DTV broadcasting for guaranteeing backward-compatibility with legacy DTV. Recently, 3DTV experimental broadcasting services are being developed around advanced countries and the standardization of service-compatible 3DTV broadcasting which is able to provide high-quality stereoscopic videos in progress. Based on experimental results, we confirm that proposed method can be used as a common technology and a reference model for stereoscopic video transmission over terrestial, satellite and cable DTV platforms in 3DTV broadcasting service and system development.

This paper proposes an efficient transmission method for the panoramic multimedia contents. The panoramic video provides wide sight and various view-point to the user. The traditional methods of the panoramic multimedia content transmission has several limitations, as follow; A client suffers a long initial delay time to play a panoramic video when it is transmitted through a limited bandwidth network, because the panoramic video has larger data size than a general video. And if a client's display device has limited resolution, such as mobile phone, laptop PC monitor, etc. it can not display the entire panoramic video that has a wide view video sequence. So, in order to overcome the obstacles, this paper proposes an efficient transmission of panoramic multimedia contents. This method will increase the transmission efficiency throughout the technique of the scene description in MPEG-4 system. Also we demonstrated the efficiency of the proposed method by comparison with existing methods.

T-DMB hybrid data service provides advanced data services while maintaining backward compatibility with legacy T-DMB receivers by using hybrid BIFS technology enabling distributed delivery of scene description information and object description information. This paper presents the hybrid service authoring framework implementing hybrid BIFS technology for creating contents for distributed delivery, and the results of experiments by using it. Hybrid service authoring framework is comprised of service creation system, service management system, and contents offering system. It enables the creation of combined hybrid data service and the splitting of the contents into two parts for ecah delivery network, data for broadcasting network and the data for mobile network. It also enables the managements of the contents. The feasibility of advanced data services while maintaining backward compatibility with the legacy T-DMB receiver has been proved by the contents created by using the hybrid authoring framework presented in this paper. Keyword : T-DMB, hybrid service, interactive data service, MPEG-4 BIFS

Recently, with the digitalization of a broadcasting system and the development of a communication technology, the existing trend of consuming media contents throughout the fixed-displayer and the dedicated channel is being changed. The existing user only could consume media contents under limited time and places because of the fixed-displayer and the dedicated channel. However, with advent of the IP-based terminals and HTTP adaptive streaming which transfer the media sequence according to the user`s transmission condition, users become possible to enjoy the media content anytime anywhere. As the result of the alteration of the broadcasting surrounding, users can enjoy the media content while changing his terminals according to their preferences and circumstances. However, in case that users try to consume consecutively the content from last view-point ended in the previous terminal under current HTTP adaptive streaming environment, a user has to remember the last view-point, and then has to apply the view-point to the changed terminal. Thus, for solving this problem, this paper defines "User Profile" for describing the metadata for the chained content consume environment between the terminals. Also, for proving the proposed method, this paper try to demonstrate the proposed method throughout the realization of the system based on Smooth Streaming from Microsoft.

This letter introduces a stereoscopic video broadcasting system that provides 3D visual service and has full backward compatibility with legacy digital television (DTV) service in the same channel capacity. The proposed stereoscopic video broadcasting system in this letter is composed of both a hybrid codec and a multiplexer with a newly defined stereoscopicrelated signaling method. In conclusion, the proposed method can be effectively applied for 3D broadcasting services without major changes in legacy broadcasting platforms.

There have been lots of technical developments in broadcasting field since 1990s. Providing high quality video and audio is one improvement and supporting mobile reception in a high-speed vehicle is another. Terrestrial Digital Multimedia Broadcasting (T-DMB) is one of the successfully deployed technologies to provide mobile broadcasting service. One of the major breakthroughs achieved by T-DMB in addition to robust vehicular reception is a system architecture naturally enabling integrated interactive data services, which is defined by MPEG-4 System architecture composed of Object Descriptor Framework and Binary Format for Scene (BiFS) technology. However, interactive service in T-DMB has two fundamental limitations. First, interactive data service should be always rendered on top of a video due to the T-DMB specification. Second, initial data for interactive service is only received by broadcasting channel. These limitations prevent the implementation of emerging data service recently deployed widely by the smart handheld devices such as personalized data service customized for the user characteristics or location-based data service. Therefore, this paper proposes the architecture of hybrid interactive data service (HIDS) for T-DMB to overcome these limitations by defining a hybrid BIFS, which supports individual scene descriptions delivered from broadcasting and mobile channels, and is accessed from the local memory. This proposed architecture also maintains backward compatibility with the already deployed legacy T-DMB receivers.

We demonstrate a commercialized injection molding method for nano patterning of polymethyl methacrylate (PMMA) for the purpose of mass production of a label-free optical biosensor chip. Scanning electron microscope (SEM) images clearly show uniform nanopattern transfer on the plastic chip fabricated by an injection molding method. A uniformly deposited silicon nitride layer having a high refractive index by a plasma enhanced chemical vapor deposition (PECVD) technique is also observed. A unique characterization method is described wherein optical resonance reflection is used accurately and quickly to characterize the geometrical sensor structure. The authors anticipate that this robust method will provide an excellent means of producing an optical resonance reflection biosensor (ORRB).

Stereoscopic video service is one of the most widely adopted technologies for 3-Dimensional technology. However, the stereoscopic video service has not been penetrated into the market since there does not exist a proper transmission method even though the conventional MPEG-2 Transport Stream (TS) has support for broadcast service of mono-scopic video contents. This is partly because the MPEG-2 TS does not support displaying a stereoscopic video content which consists of several composition types widely used in the market. This paper proposes the new MPEG-2 TS specification suitable for transmitting and displaying stereoscopic video contents. In order to show feasibility of the proposal, this paper describes an end-to-end system which is implemented with consideration of the method how to multiplex and de-multiplex stereoscopic video contents as well as keeping backward compatibility with the traditional MPEG-2 TS.

This paper presents a multimedia streaming platform for efficiently transmitting MPEG-4 content over IP networks. The platform includes an MPEG-4 compliant streaming server and client, supporting object-based representation of multimedia scenes, interactivity, and advanced encoding profiles defined by the ISO standard. For scalability purposes, we employ an application-layer multicast scheme for media transmission using overlay networks. The overlay network, governed by the central entity of the network distribution manager, is dynamically deployed according to a set of pre-defined criteria. The overlay network supports both broadcast delivery and video-ondemand content. The multimedia streaming platform is standards-compliant and utilizes widespread multimedia protocols such as MPEG-4, real-time transport protocol, real-time transport control protocol, and real-time streaming protocol. The design of the overlay network was architected with the goal of transparency to both the streaming server and the client. As a result, many commercial implementations that use industry-standard protocols can be plugged into the architecture relatively painlessly and can enjoy the benefits of the platform.

In the decoding process associated with interframe wavelet coding, the inverse wavelet transform requires high computational complexity. However, as video technology starts to pervade all aspects of our lives, decoders are becoming required in various devices such as PDAs, notebooks, PCs, and set-top boxes. Therefore, a decoder's complexity needs to be adapted to the processor's computational power, and consequently a lowcomplexity codec is also required for scalable video coding. In this paper, we propose a method of controlling and lowering the complexity of the spatial wavelet transform while sustaining the same coding efficiency as that currently afforded. In addition, the proposed method may alleviate the ringing effect for slowly changing image sequences.

Fast binary dilation and erosion algorithms using run-length encoding (RLE) are proposed. RLE is an alternative way of representing a binary image using a run, which is a sequence of '1' pixels. First, we derive the run-based representation of dilation and erosion and then present the full steps of the proposed algorithms in detail.

Recently, MPEG has opened activity to standardize scene representation for lightweight applications such as in mobile phones. The standard is named lightweight applications scene representation (LASeR) and can be applied to improve and make efficient rich media applications and services on mobile devices. In this standard, we proposed an efficient type codec for point data to maximize the bit efficiency of LASeR. In this paper, we describe the new method and the test results of the proposed scheme.

One of the recent and most significant technical properties can be expressed as “digital convergence,” which is helping lead the technical paradigm into a ubiquitous environment. As an initial trial of realizing a ubiquitous environment, the convergence between broadcasting and telecommunication fields is now on the way, where it is required to develop a scalable video coding scheme for one-source and multi-use media. Traditional scalable video coding schemes have, however, limitations for higher stable picture quality especially on the region of interest. Therefore, this paper introduces an adaptive scanning method especially designed for a higher regional-stable picture quality under a ubiquitous video coding environment, which can improve the subjective quality of the decoded video by most-preferentially encoding, transmitting, and decoding the top-priority image information of the region of interest. Thus, the video can be more clearly visible to users. From various simulation results, the proposed scanning method in this paper can achieve an improved subjective picture quality far better than the widely used raster scan order in conventional video coding schemes, especially on the region of interest, and without a significant loss of quality in the left-over region.

This paper introduces a hybrid architecture for efficient 3D video transmission on a legacy DTV channel and IP network. The hybrid architecture specifically includes a robust synchronization method on heterogeneous networks, adaptive streaming of the 3D additional view by the ISO/IEC 23009-1 DASH and transport stream system target decoder (T-STD) model for stable playback of both views. Based on experimental results, we confirm that the proposed architecture can be used as a core technology in hybrid 3DTV broadcasting and a reference model for development of various hybrid services.

As the internet network is growing up, it is possible to transmit the large capacity file such as high-quality stereoscopic 3D content. Thus, the burden of internet network is becoming heavier than before, since 3D stereoscopic video services require larger and more stable bandwidth. Also, it may cause disconnection of the streaming service to provide the large capacity content in the limited network environment. Therefore, it is necessary to develop the technology of streaming service adaptive to the network environment. In order to achieve a seamless video streaming service, the international standardization organization MPEG (Moving Pictures Experts Group) has developed an adaptive HTTP streaming technology called DASH (Dynamic Adaptive Streaming over HTTP). However, the DASH does not have an obvious scheme that can express the two elementary video stream based on the service-compatible stereoscopic contents in a single Segment sequence. Therefore, in this paper, we propose a method of efficient 3D adaptive streaming service based on the DASH, which covers service-compatible stereoscopic content in a single Segment sequence. The 3D adaptive HTTP streaming method introduced in this paper is able to provide seamless streaming service for various kinds of stereoscopic contents.

In South Korea, Broadcast companies have begun a trial 3D broadcasting service by delivering dual streams, such as a left view sequence with MPEG-2 video and a right one with MPEG-4 AVC video, within the 19.4 Mbps terrestrial bandwidth. However, this limitation of transmission bandwidth in the terrestrial broadcasting system may cause quality degradation compared to the current 2D broadcasting service. Recently, the Advanced Television System Committee (ATSC) has released a new service model called non-real-time (NRT) technology, which provides file download functionality over a terrestrial broadcasting system. And electronic manufactures have developed smart TV which enables to receive RF channel and IP protocol. In order to operate a full quality 3D service, this paper proposes an NRT-based hybrid broadcasting system in which one of two view sequences is transmitted as a real-time broadcasting program, and the other is transmitted prior to a real-time broadcasting program and is stored as a file. This system uses a method of referential relation and synchronization between MPEG-2 transport stream (TS) and the file downloaded by ATSC NRT or IP. Therefore, the proposed hybrid broadcasting system can provide stable, high quality 3D content while maintaining a backward compatibility with the current 2D broadcasting system, despite the terrestrial bandwidth limitation.

This paper proposes a method for saving resources of the video distribution server by using peer-to-peer communications. In order to adapt to a time-varying channel, scalable video coding and a fountain code, a Raptor code is used. The Raptor code protects video quality asymmetrically according to the significance of scalable video layers; varying in peer-to-peer networks, as a forward error correction (FEC) method. It is also a more efficient peer-to-peer distribution tool (because of its rateless feature) than conventional erasure recovery FEC such as the Reed Solomon code. The simulation shows that peer-to-peer data exchange between the clients can save the resources of the server.

A lot of 3D contents haven been widely used for multimedia services, however, real 3D video contents have been adopted for a limited applications such as a specially designed 3D cinema. This is because of the difficulty of capturing real 3D video contents and the limitation of display devices available in a market. However, diverse types of display devices for stereoscopic video contents for real 3D video contents have been recently released in a market. Especially, a mobile phone with a stereoscopic camera has been released in a market, which provides a user as a consumer to have more realistic experiences without glasses, and also, as a content creator to take stereoscopic images or record the stereoscopic video contents. However, a user can only store and display these acquired stereoscopic contents with his/her own devices due to the non-existence of a common file format for these contents. This limitation causes a user not share his/her contents with any other users, which makes it difficult the relevant market to stereoscopic contents is getting expanded. Therefore, this paper proposes the common file format on the basis of ISO base media file format for stereoscopic contents, which enables users to store and exchange pure stereoscopic contents. This technology is also currently under development for an international standard of MPEG as being called as a stereoscopic video application format.

This paper introduces an interactive contents authoring system which can easily and conveniently produce interactive contents for the Terrestrial Digital Multimedia Broadcasting (T-DMB). For interactive broadcasting service, T-DMB adopted MPEG-4 Systems technology. In order to the interactive service becomes flourishing on the market, various types of interactive contents should be well provided prior to the service. In MPEG-4 Systems specification, broadcasting contents are described by the combination of a large number of nodes, routes and descriptors. In order to provide interactive data services through the T-DMB network, it is essential to have an interactive contents authoring system which allows contents authors to compose interactive contents easily and conveniently even if they lack any background on MPEG-4 Systems technology. The introduced authoring system provides powerful graphical user interface and produces interactive broadcasting contents in the forms of binary and textual format. Therefore, the interactive contents authoring system presented in this paper would vastly contribute to the flourishing interactive service.

This paper describes issues and consideration on authoring of interactive multi-view visual content based on MPEG-4. The issues include types of multi-view visual content; functionalities for user-interaction; scene composition for rendering; and multi-view visual content file format. The MPEG-4 standard, which aims to provide an object based audiovisual coding tool, has been developed to address the emerging needs from communications, interactive broadcasting as well as from mixed service models resulting from technological convergence. Due to the feature of object based coding, the use of MPEG-4 can resolve the format diversity problem of multi-view visual contents while providing high interactivity to users. Throughout this paper, we will present which issues need to be determined and how currently available tools can be effectively utilized for interactive multi-view visual content creation.

This paper presents the design of MPEG-4 contents streaming system that provides object-based interactivity over IP networks, and shows the execution results of the proposed streaming system. The proposed streaming system deploys overlay network to support application-level multicast.

In this paper, we propose the MPEG-7 over MPEG-4 systems decoder, which is compatible with MPEG-4 systems specification and added MPEG-7 module, which uses OCI and MPEG-7 textual descriptor for content search, and it is provides content management and metadata information.

Recently, MPEG opens activity to standardize scene representation for lightweight application on mobile phone. The standard is named as LASeR, which is to improving and making efficient rich media application and services on mobile device. In this standard, a method for simple aggregation format (SAF) are provided, which is a streaming-ready format for packaging scenes and media together and streaming them onto such protocols as HTTP, TCP, MPEG-2, and so on. In this paper, we introduce SAF and show how different between a similar standard, MPEG-4 systems, and LASER.

This paper describes issues and consideration on authoring of multi-view visual content based on MPEG-4 systems. The issues include types of 3D visual content; functionalities for user-interaction; 3D scene composition for rendering; and the 3D visual content file format. MPEG-4 includes several extensions compared to MPEG-1 and -2 especially in terms of object-based interactivity. In addition to advanced A/V compression methods (MPEG-4 Part2, Part3 and Part10), MPEG-4 Part1, which is named "Systems", contains additional tools such as binary/textual file format, multiplexing, synchronization scheme, scene description, etc. The use of MPEG-4 can resolve the problem of format diversity while providing high interactivity to users.

This paper describes issues and consideration on authoring of 3D visual content based on MPEG-4 Systems. The issues include types of 3D visual content; functionalities for user-interaction; 3D scene composition for rendering; and the 3D visual content file format. MPEG-4 includes several extensions compared to MPEG-1 and -2 especially in terms of object-based interactivity. In addition to advanced A/V compression methods (MPEG-4 Part2, Part3 and Part 10), MPEG-4 Part1, which is named "Systems", contains additional tools such as binary/textual file format, multiplexing, synchronization scheme, scene description, etc. The use of MPEG-4 can resolve the problem of format diversity while providing high interactivity to users. There has been little investigation on 3D visual content authoring. Throughout the paper, we will present which issues need to be determined and how currently available tools can be effectively utilized for 3D visual content creation.

In this paper, we present an effective streaming method for MPEG-4 contents using the schedule information of image objects and progressive JPEG. The proposed method is designed for Interactive Scalable Multimedia Streaming (ISMuS) system. In rich interactive contents, the amount of image objects is not negligible for a streaming service with QoS. If a streaming system does not manage the image data, it could create a bottleneck in the system. The proposed method considers the schedule information of image objects to be displayed within a specific time frame, generally within a few second. Since the proposed method uses the progressive JPEG instead of Baseline JPEG, it treats image object as scalable Object. The streaming server sends surely DC data of each image object and AC data of image object is sent only when there is an enough room for AC data in network bandwidth. The priorities of audio and video elementary stream are also within the consideration as well as those image objects according to the varying network status.

In recent years, we have seen a vast increase in interactive broadcasting content research based on MPEG-4 and multimedia content description research based on the MPEG-7 standard. Also, there is a rising research area to compromise between the MPEG-4 and the MPEG-7 standard for a new application domain such as the interactive broadcasting server, and so on. Especially, MPEG-4 and MPEG-7 based interactive content allows a user to watch preferred broadcasting programs by using retrieval functionalities. In this paper, we present the first results of the MPEG-7 over MPEG-4 research and introduce the prototype of an interactive broadcasting contents authoring and searching system using the MPEG-7 over MPEG-4 scheme

Advances in Internet technology and provision of constantly increasing bandwidth capabilities to end-users, have increased the need for streaming media services that can match the quality of traditional TV broadcast and offer enhanced user interactivity. In this paper, the target services, as well as specific implementation details of a scalable interactive multimedia streaming platform named ISMuS is presented. The platform is capable of providing high quality streaming service based on MPEG-4 encoded streams, through the use of scalable video coding technology and a media distribution architecture based on overlay network technology

The digital multimedia broadcasting (DMB) adopted the MPEG-4 standard as the AV standard. And the development of DMB and MPEG-4 led to the necessity of the various contents. In MPEG-4, two types of file format such as MPEG-4 file format (MP4) and extensible MPEG-4 textual format (XMT) which are the format to express the contents are defined for the composition of objects. Each format has its advantages and disadvantages. To supplement these pros and cons, the conversion from one to the other format is used. Converting from one to the other is the essential element for efficient authoring, streaming and management of multimedia contents based on MPEG-4. Therefore, implementing a converter is the one of the most important things to handle the contents efficiently. In this paper, the design and implementation of XMT-A to/from MP4 converter which supports the AVC file format are presented for interactive DMB services.

Within the last years, the enormous growth of Internet based communication as well as the rapid increase of available processing power has lead to the widespread use of multimedia streaming as a means to convey information. This work aims at providing an open architecture designed to support scalable streaming to a large number of clients using application layer multicast. The architecture is based on media relay nodes that can be deployed transparently to any existing media distribution scheme, which can support media streamed using the RTP and RTSP protocols. The architecture is based on overlay networks at application level, featuring rate adaptation mechanisms for responding to network congestion.

In this paper, we present an MPEG-4 contents streaming system and propose MPEG-4 contents streaming scheme by using priority. The presented streaming system which consists of a server and a client supports MPEG-4 contents compliant with ISO/IEC 14496-1 and enables a user to interact with MPEG-4 contents over IP networks. The server consists of GUI, Server Management Layer, Sync Layer, and Delivery Layer. The client supports to display MPEG-4 contents stored in local storage or received through IP networks. Moreover, we propose an MPEG-4 contents streaming scheme that the object a user prefers to watch is sent first by increasing priority and objects with low priority are dropped at a server side when network bandwidth is not enough to transmit all objects that are supposed to appear in the scene. We made experiment of the proposed scheme with the presented MPEG-4 contents streaming system, and the experiment results are shown in this paper. If we use the proposed scheme for MPEG-4 contents streaming, it is possible for a user to watch a video of interest in high quality and video of indifference in low quality.

In this paper, we present interactive contents streaming system over IP networks. The proposed streaming system enables users to remotely interact with MPEG-4 contents. We describe the architecture and behaviors of the proposed streaming system, and experimental result in this piper. The presented streaming system was designed and implemented to select suitable transmission protocol according to media type. For real time streaming and network status monitoring, the proposed streaming system uses RTP (Real-time transport protocol), and RTCP (RTP control protocol). And also, the presented streaming system uses TCP in order to transmit IOD(lnitial Object Descriptor), OD(Object Descriptor), BIFS (Binary Format for Scene), and for loss-sensitive media data such as still image.

In MPEG-4, two types of file format such as MPEG-4 file format (MP4) and eXtensible MPEG-4 textual format WMT) are defined for the composition of objects. Since, MP4 and XMT are describing the MPEG-4 based interactive multimedia contents in different ways, such as binary and text, each format have their advantages and disadvantages. Therefore, the converting from one to the other format is one of the essential functionality for efficient authoring, streaming and management of multimedia contents based on MPEG-4. And as the development of the digital broadcasting, we have seen a vast increase in digital contents. Therefore it .needs retrieve the interactive MPEG-4 contents easily. In this paper, design and implementation of XMT-A to/from MP4 converter for authoring and retrieving the MPEG-4/7 based interactive multimedia contents is presented.

Lately, there has been a vast increase in interactive broadcasting contents research using the MPEG-4 standard and in multimedia content description research using the MPEG-7 standard. Also, there are few researches into a compromise between the MPEG-4 standard and the MPEG-7 standard for newer applications, such as an interactive broadcasting contents server, which is able to query and search. The paper presents the first results of research on the MPEG-7 interface over MPEG-4 systems, which makes it easy to search MPEG-4 content. We have developed an MPEG-7 interface embedded in MPEG-4 systems and an MPEG-4 player that provides a query function and a search function.

In this paper, the extended BIFS (Binary Format for Scene) of MPEG (Moving Picture Experts Group)-4 is proposed for augmented stereoscopic video. BIFS is a scene graph for MPEG-4, and is based on VRML (Virtual Reality Markup Language). ASV (augmented stereoscopic video) is thought as an off-line AR (augmented reality). Thus, there are some mismatch problems when augmented stereoscopic video presents in BIFS. In AR, the registration is a key technology. BIFS does not support that. We introduce a registration mechanism to BIFS. Also, in this paper new nodes are proposed for stereoscopic and camera information stream.

This paper presents a new indexing system, which divides an image into higher and lower entropy regions, and calculates the color correlation features between each type of region. Thus, we can improve the discrimination power of color indexing techniques. The indexing system proposed in this paper has three important properties. The first is an entropy feature. An image is divided by an entropy feature into two regions, lower and higher entropy regions in order to avoid the problems caused by general global features. The second is a color correlation feature. This paper uses 2-dimensional probability distribution functions of an image to obtain color moment features, and thus, obtain more information than using 1-dimensional probability distribution functions (i.e. histogram). The last is the retrieval procedure consisting of two steps: firstly, a simple retrieval algorithm is applied to all the images in a database, and secondly, only the results of the previous retrieval are searched. Thus, it can help in reducing the total retrieval time and improving the retrieval accuracy.

With a very large size image database, there should be a way to search for the similar images efficiently. However, the traditional approaches that have been adopted to retrieve text or scalar values cannot be used because of the multi-dimensionality of the image feature vectors. A new retrieval method that uses one or more scalar values induced from the image vector is proposed. In the proposed method, the scalar values are independently stored as indices to the target feature vectors. With the proposed method, the searching speed is improved approximately 25 times compared to the sequential searching.

Since multimedia data is widely used in many fields, research is needed on how to search that data. As a method of retrieving multimedia data, especially for image data, content based image retrieval (CBIR) systems have obtained lots of interest. In order to develop CBIR systems, many different properties of an image have been considered for methods of retrieving image data such as colour, texture, shape, etc. The paper proposes a simple and efficient image retrieval algorithm, which retrieves images on the basis of subregional texture characteristics. In order to retrieve images in terms of contents, it is in general required to obtain a precise segmentation. However, it is very difficult and takes a lot of computing time for precise segmentation. Therefore, the proposed algorithm subdivides an image in terms of a certain sized windows, and finds out whether an image contains a query pattern on the basis texture features. Also, these texture features are described by only six different texture features produced from a co-occurrence matrix. For an image retrieval system, a normalised correlation is adopted as a similarity function, which is not dependent on the range of texture feature values. Finally, the proposed algorithm is applied to various images and produces competitive results.

In this paper, we propose an efficient navigation algorithm employing fuzzy theory, which does not need analytical models on an environment. A technique that a single module can drive multiple ultrasonic sensors is presented. In addition, an ultrasonic sensor drive circuitry design for detection and avoidance of unknown obstacles is described. Finally, this paper presents the efficiency of the proposed fuzzy algorithm both through simulation and through floor test.

In multimedia services, digital video is one of the most important contents. However, until now the searching and browsing of video have depended on the traditional technologies developed mainly for text, which is obviously insufficient, considering the special characteristics of digital video. A novel video retrieval system that is under development at ETRI is introduced. In designing the system, two major user groups (information providers and end users) are considered. For information providers, the system provides tools that support efficient construction of a video database. For end users, an easy and convenient searching and browsing functionality is provided.

We propose an image retrieval system using the Borda count method in combining multiple experts (CME). It combines color-, shape- and texture-based retrieval systems. CME method can complementarily combine results of each retrieval system, which uses different features. There are some problems when the Borda count method in pattern recognition is applied to image retrieval. Thus, we propose a modified Borda count method to solve these problems. In the experiment our method reduces false positive errors and produces better results than that of each retrieval module that uses only one feature.