FREE ELECTRONIC LIBRARY - Dissertations, online materials

Pages:   || 2 | 3 | 4 | 5 |   ...   | 16 |

«Jiangqin Sun B.S. Soochow University, 2007 M.S. Harbin Institute of Technology, 2009 A dissertation submitted in partial fulfillment of the ...»

-- [ Page 1 ] --

Temporal Signature Modeling and Analysis


Jiangqin Sun

B.S. Soochow University, 2007

M.S. Harbin Institute of Technology, 2009

A dissertation submitted in partial fulfillment of the

requirements for the degree of Doctor of Philosophy

in Imaging Science

Chester F. Carlson Center for Imaging Science

College of Science

Rochester Institute of Technology

December 6, 2014

Signature of the Author

Accepted by

Coordinator, Ph.D. Degree Program Date






Ph.D. DEGREE DISSERTATION The Ph.D. Degree Dissertation of Jiangqin Sun has been examined and approved by the dissertation committee as satisfactory for the dissertation required for the Ph.D. degree in Imaging Science Dr. David Messinger, Dissertation Advisor Dr. Tony Harkin, Committee Member Dr. Joel Kastner, Committee Member Dr. Carl Salvaggio, Committee Member Date i ABSTRACT A vast amount of digital satellite and aerial images are collected over time, which calls for techniques to extract useful high-level information, such as recognizable events. One part of this thesis proposes a framework for streaming analysis of the time series, which can recognize events without supervision and memorize them by building the temporal contexts. The memorized historical data is then used to predict the future and detect anomalies. A new incremental clustering method is proposed to recognize the event without training. A memorization method of double localization, including relative and absolute localization, is proposed to model the temporal context. Finally, the predictive model is built based on the method of memorization. The “Edinburgh Pedestrian Dataset”, which offers about 1000 observed trajectories of pedestrians detected in camera images each working day for several months, is used as an example to illustrate the framework.

Although there is a large amount of image data captured, most of them are not available to the public. The other part of this thesis developed a method of generating spatial-spectral-temporal synthetic images by enhancing the capacity of a current tool called DIRISG (Digital Imaging and Remote Sensing Image Generation). Currently, DIRSIG can only model limited temporal signatures. In order to observe general temporal changes in a process within the scene, a process model, which links the observable signatures of interest temporally, should be developed and incorporated into DIRSIG. The sub process models could be categorized into two types. One is that the process model drives the property of each facet of the object changing over time, and the other one is to drive the geometry location of the object in the scene changing as a function of time. Two example process models are used to show how process models can be incorporated into DIRSIG.

ii Acknowledgements

The Ph.D. study at RIT was a great experience for me. During the last few years, I was offered a lot of opportunities to learn and grow. I feel grateful to all the people I meet at RIT, who altogether makes RIT a warm place to stay.

First, I would like to thank my advisor, Dr. David Messinger, for his constant support, encouragement, and patience. He has been a wonderful advisor in balancing guidance and giving freedom to students, which allows us to work effectively and creatively. This work would not be possible without his mentoring.

I also would like to thank my committee members: Dr. Tony Harkin, Dr. Carl Salvaggio and Dr. Joel Kastner for taking the time to provide their support and give me valuable feedback on my work.

I would like to thank Dr. Michael Gartley for his kindness to teach me DIRSIG.

Many thanks to Jason Faulring for helping me setting up the parking lot experiment.

I thank Rolando Raqueño, Andrew Scott, and Nina Raqueño for their discussion, feedback, and support in the parking lot modeling in DIRSIG.

I would like to all the CIS admin staff, who makes things so well organized. In particular I’d like to thank Cindy Schultz, Sue Chan, Marilyn Lockwood, and Joyce French.

It would be very difficult for me to complete the Ph.D. study without the support from friends, roommates, and fellow graduate students. Special thanks to Dr.

Weihua Sun, Lin Chen, Dr. Yujie Qiu, Wei Yao and Fan Jiang for their support and companion through the toughest first year study in U.S..

Most importantly, I would like to thank my family for being always supportive to whatever decision I made. I would like to thank my Fiancé Philipp for his caring, encouragement, and making me a better person.

–  –  –

3.1 Scenarios of parking spot status change................ 62

3.2 Result Accuracy analysis of the parking status extraction...... 63

–  –  –

Introduction More than 150 Earth observation satellites are currently in orbit carrying sensors to monitor the earth and provide us a large number of valuable images[101]. Many companies and government agencies are still working on constructing next generation satellites. For example, the ESA is developing five new missions called Sentinels to complement the capacities of the existing satellites in the next several years[2].

Besides, there are many airborne sensors available to take images of certain sites when required. During the 2012 summer, RIT (Rochester Institute of Technology) performed a large scale experiment in Avon area of Rochester which is named as SHARE2012. Several types of airborne sensors (including WASP, ALS-60, ProSpecTIR VS, MircroHSI and PI Sensor[86]) flew over the site with targets set up in a designed way. The ground truth was measured and recorded along with the weather information. The collected data are shared around the world. The large amount of temporal digital satellite and aerial images calls for the corresponding development in data processing techniques to combine and fuse the temporal data from different sources in order to understand the data in a high level, such as extracting hidden events or activities. One part of the thesis will focus on building a generic framework to capture the temporal events from the data.

Although there is a large amount of image data captured and stored over time, most of them are not available to the public. The experiment event like SHARE2012


at RIT does not happen often, because such large scale experiments involve intense amount of efforts and time. Besides, a lot of the data do not offer the “ground truth”, which is required to test and validate the algorithm. The other part of the thesis will focus on generating temporal synthetic images by enhancing the capacity of a current tool called DIRISG (Digital Image and Remote Sensing Image Generation).

In this thesis, we will illustrate temporal signature modeling in DIRSIG first to provide a method to generate the spatial-spectral-temporal synthetic remote sensing images. This could further aid the research in temporal signature analysis by offering the test data and their “ground truth”.

1.1 Temporal Signature Modeling in DIRSIG The DIRS lab (Digital Imaging and Remote Sensing Laboratory) at Rochester Institute of Technology has spent the past 20+ years developing the DIRSIG tool. Over the past 20+ years, DIRSIG has been involved with a great development starting from simplistic thermal image rendering of a 2D scene. Nowadays, the DIRSIG is a complex synthetic image generation model of 3D scene, which also is designed to produce broad-band, multi-spectral and hyper-spectral imagery through the integration of a suite of first principles based radiation propagation sub models. These sub models are responsible for tasks ranging from the BRDF (bi-directional reflectance distribution function) predictions of a surface to the dynamic scanning geometry of a line scanning imaging instrument. In addition to sub models that have been specifically created for the DIRSIG model, there are also components such as MODTRAN (MODerate resolution atmospheric TRANsmission) and FASCODE which are included in DIRSIG as workhorses for the multi- and hyper-spectral community.

All modeled components are combined using a spectral representation, and the integrated radiance images can be simultaneously produced for an arbitrary number of user defined band passes. According to the surface temperature of the scene, the self-emitted radiances are calculated by a passive thermodynamic model which includes the time history of environmental and meteorological parameters[31]. Then


the surface reflected radiances are determined to compute the sensor reaching radiances through the included MODTRAN model. DIRSIG can produce multi or hyper-spectral remote sensing images between the bandpass 0.2 to 20 m with high radiometric fidelity[31, 92]. In addition, DIRSIG also produces per-pixel “truth”, so many algorithm developers take this advantage of DIRSIG to validate their algorithms and make improvements.

However, except for vehicle moving, the solar and historical weather related short term temporal changing, DIRSIG does not currently include long term temporal signatures of the scene easily. To perform trade studies, algorithm training or even hypothesis testing, the user needs to manually create the scene with each individual element changing frame by frame as a function of time, which is time consuming and labor intensive. Take the scene of MCV (Midland Cogeneration Venture) Power Plant in Michigan for example: Figure 1.1 shows the WASP[73] images of the midland scene. By zooming in the center part of the scene, more details of the scene can be observed; there are various kinds of activities going on there, such as tanks with water filled in and released out, stacks releasing plumes, parking lots with cars arriving and leaving, a lake with surface temperature changing over the year and so on. In order to accurately describe the scene at a specific time, the user is required to manually set all characterizations for each scene element. For example, the user needs to figure out how much water is in the tanks and what is the temperature, which direction the plume would be blown and how strong the wind is, how many cars in the parking lot and how they are distributed, how the surface temperature of the lake looks like and so on. When time changes, the user needs to re-attribute all these properties to the scene element, which is a tedious process.

–  –  –

GIS (Geographic Information System) is a spatial temporal system designed to store, manage, process, and visualize time varying geographical data. Over time, GIS uses snapshot model, space time composite, spatio-temporal object model, event-based/state-based model, object-oriented model, version-difference model and so on to represent the spatial temporal geographical data in the spatio-temporal database[100]. The dynamical property of GIS is shown in the database, and the representation of the relationship between the dynamic object elements in GIS is achieved through the management of so called relational database. Recently, the integration of process models and GIS is beginning to be realized and the proposed next generation GIS will use process models to govern the dynamics, adaption and evolution among the object elements in the system[102].

BIM (Building Information Modeling) is a intelligent model-based building design system, which incorporates the physical and functional characteristics into the


system. BIM which integrates the time information to the three spatial dimensions is often referred to as 4D BIM. 4D BIM uses a process model to direct the life cycle of a project by linking all the model elements in the construction schedule[3]. Each model element describes a discrete, time-driven construction activity as stated in the schedule. 4D BIM can facilitate the decision makers to learn a intuitive understanding of the process by visualizing the whole result consisting of different event phenomena from different model elements on the time axe.

In the field of computer graphics, a lot of work has been done on measuring and modeling the time-varying appearance of the natural phenomena[98, 44, 107].

Gu et al[44] develops a model called space-time appearance factorization to factor space and time-varying effects. Sun et al[98] measured the time-varying BRDFs of a wide range of phenomena with a self-developed acquisition system at a time sample space within 36 seconds and shared the database online. Those modeled natural phenomena include drying of various types of paints[107], wetting and drying of rough surfaces(cement, plaster and fabrics)[107, 44], the accumulation of dusts on surfaces[52, 107], corrosion and rusting of metals[44, 74], the weathering stone[34] and so on. These time-varying appearance of the different materials and surfaces are also interesting to remote sensing communities.

The first part of this thesis is intended to show the research of incorporating temporal signatures of the scene into DIRSIG, and these temporal signatures of the scene are driven by the process model. The enhanced DIRSIG could automatically create a scene with the property of each individual element driven by an external physical model as a function of time. The global process model could comprise many sub process models, each of which is designed to describe the temporal changing characterizations of the corresponding element in the scene. The changing characterizations of a scene element may include temperature, material property, geometry position and orientation, and so on. This research would enhance the ability of DIRSIG to simulate a complex scene with diverse activities and aid the algorithm development and test community to save significant and labor. By adopting the method of incorporating process models into DIRSIG, finally we expect to be able to create a scene which could capture not only spatial-spectral information,


Pages:   || 2 | 3 | 4 | 5 |   ...   | 16 |

Similar works:

«University of California Transportation Center UCTC Dissertation No. 159 Network Design Formulations, Modeling, and Solution Algorithms for Goods Movement Strategic Planning Pruttipong Apivatanagul University of California, Irvine 2008 UNIVERSITY OF CALIFORNIA IRVINE Network Design Formulations, Modeling, and Solution Algorithms for Goods Movement Strategic Planning DISSERTATION submitted in partial satisfaction of the requirements for the degree of DOCTOR OF PHILOSOPHY in Transportation...»

«Service Introduction in an Active Network by David J. Wetherall E.E. Massachusetts Institute of Technology 1995 S.M. Massachusetts Institute of Technology 1994 B.E. University of Western Australia 1989 Submitted to the Department of Electrical Engineering and Computer Science in partial ful llment of the requirements for the degree of Doctor of Philosophy at the Massachusetts Institute of Technology February 1999 c Massachusetts Institute of Technology 1998. All rights reserved. Author....»

«Low-Temperature Sintering of Nanoscale Silver Paste for Semiconductor Device Interconnection by Guofeng Bai Dissertation submitted to the faculty of the Virginia Polytechnic Institute and State University in partial fulfillment of the requirement for the degree of Doctor of Philosophy in Materials Science and Engineering Dr. Guo-Quan Lu, Chair Dr. Dushan Boroyevich Dr. Sean G. Corcoran Dr. William T. Reynolds, Jr. Dr. J. Daan van Wyk October 2005 Blacksburg, Virginia Keywords: Electronic...»

«FROM GEOMETRY TO NUMBER The Arithmetic Field implicit in Geometry Johan Alm Contents Preface v Chapter 1. Kinds of Number in Early Geometry 1 1. Pythagorean natural philosophy 1 2. Plato and Euclid 4 Chapter 2. Fields and Geometric Construction 7 1. Line segment arithmetic 7 2. The Hilbert field 12 3. The constructible field 13 4. The real field 15 Chapter 3. The main theorems 17 1. The Cartesian space over a field 17 2. Faithful models 17 3. Three theorems 18 4. Proof of the first theorem...»

«TELOMERE DYNAMICS AND TELOMERASE-INDEPENDENT CELL SURVIVAL IN Arabidopsis thaliana A Dissertation by JAMES MATTHEW WATSON Submitted to the Office of Graduate Studies of Texas A&M University in partial fulfillment of the requirements for the degree DOCTOR OF PHILOSOPHY May 2007 Major Subject: Biochemistry TELOMERE DYNAMICS AND TELOMERASE-INDEPENDENT CELL SURVIVAL IN Arabidopsis thaliana A Dissertation by JAMES MATTHEW WATSON Submitted to the Office of Graduate Studies of Texas A&M University in...»

«POOL AND FLOW BOILING OF NOVEL HEAT TRANSFER FLUIDS FROM NANOSTRUCTURED SURFACES A Dissertation Presented to The Academic Faculty by Aravind Sathyanarayana In Partial Fulfillment of the Requirements for the Degree Doctor of Philosophy in the George W. Woodruff School of Mechanical Engineering Georgia Institute of Technology December 2013 Copyright © 2013 by Aravind Sathyanarayana POOL AND FLOW BOILING OF NOVEL HEAT TRANSFER FLUIDS FROM NANOSTRUCTURED SURFACES Approved by: Dr. Yogendra Joshi,...»

«MONITORING-AS-A-SERVICE IN THE CLOUD A Thesis Presented to The Academic Faculty by Shicong Meng In Partial Fulfillment of the Requirements for the Degree Doctor of Philosophy in the School of Computer Science Georgia Institute of Technology May 2012 MONITORING-AS-A-SERVICE IN THE CLOUD Approved by: Professor Ling Liu, Advisor Professor Leo Mark School of Computer Science School of Computer Science Georgia Institute of Technology Georgia Institute of Technology Professor Calton Pu Professor...»

«Illuminati, zombies and metaphysical gridlock1 Katalin Balog Rutgers Newark During the last two decades there has been a resurgence of arguments against physicalism and for varieties of metaphysical dualism. The conclusion of these arguments is that phenomenal consciousness is absent from a world that is purely physical. Many contemporary philosophers of mind have found some of these arguments to be persuasive and have opted for some form of anti-physicalism.2 In this paper I will survey the...»

«On Ethical Thoughtfulness Item type text; Electronic Dissertation Authors Matteson, Jason Kent Publisher The University of Arizona. Rights Copyright © is held by the author. Digital access to this material is made possible by the University Libraries, University of Arizona. Further transmission, reproduction or presentation (such as public display or performance) of protected items is prohibited except with permission of the author. Downloaded 23-Nov-2016 06:46:30 Link to item...»

«The Relationship Between Phenomenality and Intentionality Comments On Siewert's The Significance Of Consciousness Brie Gertler Department of Philosophy University of Wisconsin 5815 H.C. White Bldg 600 North Park St. Madison, WI 53706 U.S.A. bgertler@facstaff.wisc.edu Copyright (c) Brie Gertler 2001 PSYCHE, 7(17), October 2001 http://psyche.cs.monash.edu.au/v7/psyche-7-17-gertler.html KEYWORDS: Phenomenal character, intentional content, representation, consciousness, what it's like. COMMENTARY...»

«Der Sechste Zhva dmar pa Chos kyi dbang phyug (1584–1630) und sein Reisebericht aus den Jahren 1629/1630: Studie, Edition und Übersetzung Inaugural-Dissertation zur Erlangung des Doktorgrades der Philosophie an der Ludwig-Maximilians-Universität München vorgelegt von: Navina Lamminger Datum der mündlichen Prüfung: 28. Januar 2013 Gutachter: Prof. Dr. Franz-Karl Ehrhard Prof. Dr. Jens-Uwe Hartmann Inhaltsverzeichnis Danksagung vii 1. Allgemeine Einführung und Aufbau der Arbeit 1 1.1...»

«Computationally Optimizing the Directed Evolution of Proteins Thesis by Christopher Ashby Voigt In Partial Fulfillment of the Requirements for the Degree of Doctor of Philosophy California Institute of Technology Pasadena, California, USA 2002 (Submitted July 25, 2002) ii © 2002 Christopher Ashby Voigt All Rights Reserved iii Abstract Directed evolution has proven a successful strategy for protein engineering. To accelerate the discovery process, we have developed several computational methods...»

<<  HOME   |    CONTACTS
2016 www.dissertation.xlibx.info - Dissertations, online materials

Materials of this site are available for review, all rights belong to their respective owners.
If you do not agree with the fact that your material is placed on this site, please, email us, we will within 1-2 business days delete him.