Deep reinforcement learning is an area of research that has blossomed tremendously in recent years and has shown remarkable potential in computer games. Real-time strategy game has become an important field of artificial intelligence in game for several years. This paper is about to introduce a kind of algorithm that used to train agents to fight against computer bots. Not only because games are excellent tools to test deep reinforcement learning algorithms for their valuable insight into how well an algorithm can perform in isolated environments without the real-life consequences, but also real-time strategy games are a very complex genre that challenges artificial intelligence agents in both short-term or long-term planning. In this paper, we introduce some history of deep learning and reinforcement learning. Then we combine them with StarCraft. PPO is the algorithm which have some of the benefits of trust region policy optimization (TRPO), but it is much simpler to implement, more general for environment, and have better sample complexity. The StarCraft environment: Blood War Application Programming Interface (BWAPI) is open source to test. The results show that PPO can work well in BWAPI and train units to defeat the opponents. The algorithm presented in the thesis is …

This thesis presents a new approach to extend and reduce the transmission range in wireless systems. Conditioning is defined as purposeful electromagnetic interference that affects a wireless signal as it propagates through the air. This interference can be used constructively to enhance a signal and increase its energy, or destructively to reduce energy. The constraints and limitations of the technology are described as a system model, and a flow chart is used to describe the circuit process. Remaining theoretical in nature, practical circuit implementations are foregone in the interest of elementary simulations depicting the interactions of modulated signals as they experience phase mismatch. Amplitude modulation and frequency modulation are explored with using both positive and negative conditioning, and conclusions to whether one is more suitable than the other are made.

The Chief Security Officer Problem (CSO) consists of a CSO, a group of agents trying to communicate with the CSO and a group of eavesdroppers trying to listen to the conversations between the CSO and its agents. Through Lemmas and Theorems, several Information Theoretic questions are answered.

Formation control is a classical problem and has been a prime topic of interest among the scientific community in the past few years. Although a vast amount of literature exists in this field, there are still many open questions that require an in-depth understanding and a new perspective. This thesis contributes towards exploring the wide dimensions of formation control and implementing a formation control scheme for a group of multi-agent systems. These systems are autonomous in nature and are represented by double integrated dynamics. It is assumed that the agents are connected in an undirected graph and use a leader-follower architecture to reach formation when the leading agent is given a velocity that is piecewise constant. A MATLAB code is written for the implementation of formation and the consensus-based control laws are verified. Understanding the effects on formation due to a fixed formation geometry is also observed and reported. Also, a link that describes the functional similarity between desired formation geometry and the Laplacian matrix has been observed. The use of Laplacian matrix in stability analysis of the formation is of special interest.

This study compares independent use of two known algorithms (Kalmar filter with background subtraction and Particle Filter) that are commonly deployed in object tracking applications. Object tracking in general is very challenging; it presents numerous problems that need to be addressed by the application in order to facilitate its successful deployment. Such problems range from abrupt object motion, during tracking, to a change in appearance of the scene and the object, as well as object to scene occlusions, and camera motion among others. It is important to take into consideration some issues, such as, accounting for noise associated with the image in question, ability to predict to an acceptable statistical accuracy, the position of the object at a particular time given its current position. This study tackles some of the issues raised above prior to addressing how the use of either of the aforementioned algorithm, minimize or in some cases eliminate the negative effects

The major advantages of radio frequency identification (RFID) technology over barcodes are that the RFID-tagged objects do not require to be in line-of-sight with the reader for their identification and multiple objects can be read simultaneously. But when multiple objects are read simultaneously there is always a problem of collision which reduces the efficiency of the system. This thesis presents a comprehensive study of the dynamic framed slotted ALOHA (DFSA)-based anti-collision multi-tag identification algorithms for passive RFID system. Performance of various DFSA algorithms is compared through extensive simulation results. In addition, a number of simple performance improvement techniques have also been investigated in this thesis, including improved estimation techniques for the number of tags in each read cycle and a low-complexity heuristic stopping criterion that can be easily implemented in the practical system.

In light of incidents and concerns regarding the vulnerability of the global positioning system (GPS), the main purpose of the thesis is to look at alternative systems for radio guidance and to put up a serious study on such alternatives with receive and transmit antenna. There is also the need to design such antennas with multiple frequencies to offer robustness in the unlikely event that such adversarial attacks on the GPS happen. The basis on which such alternative antennas are designed is a slotted microstrip. The characteristics of the slot or slots on the microstrip are analyzed by mapping their exact locations on the patch and then noting the resultant center frequencies, the return losses, and the bandwidth. The activities associated with this also focus on the design, fabrication, validation, and characterization of one or more slotted antennas prototypes. The measurement of the antenna prototypes does confirm several frequencies that coexist to see applications, in aeronautical radionavigation, fixed-mobile radionavigation, and radiolocation. The antennas could also feature in a wide-area augmentation system (WAAS), satellite ground link system (SGLS) as well as in surveillance and precision approach radars. Some variations of the antenna are deployed in the areas of law enforcement, surveillance, …

The thesis deals with the design and implementation of broadband and narrowband antennas and their applications in practical environment. In this thesis, a new concept for designing the UWB antenna is proposed based on the CRLH metamaterials and this UWB antenna covers a frequency range from 2.45 GHz to 11.6 GHz. Based on the design of the UWB antenna, another antenna is developed that can cover a very wide bandwidth i.e from 0.66 GHz to 120 GHz. This antenna can not only be used for UWB applications but also for other communication systems working below the UWB spectrum such as GSM, GPS, PCS and Bluetooth. The proposed antenna covering the bandwidth from 0.66 GHz to 120 GHz is by far the largest bandwidth antenna developed based on metamaterials. Wide band antennas are not preferred for sensing purpose as it is difficult to differentiate the received signals. A multiband antenna which can be used as a strain sensor for structural health monitoring is proposed. The idea is to correlate the strain applied along the length or width with the multiple resonant frequencies. This gives the advantage of detecting the strain applied along any direction (either length or width), thus increasing the …

As technology has advanced, data has become more and more important. The more breakthroughs are achieved, the more data is needed to support them. As a result, more storage is required in the system's memory. Compression is therefore required. Before it can be stored, the data must be compressed. To ensure that information is not lost, efficient compression is necessary. This also makes sure that there is no redundancy in the data that is being kept and stored. Compressive sensing has emerged as a new field of compression thanks to developments in sparse optimization. Rather than relying just on compression and sensing formulations, the theory blends the two. The objective of this thesis is to analyze the concept of compressive sensing and to study several reconstruction algorithms. Additionally, a few of the algorithms were put into practice. This thesis also included a model of the ECG, which is vital in determining the health of the heart. For the most part, the ECG is utilized to diagnose heart illness, and a modified synthetic ECG can be used to mimic some of these arrhythmias.

Piezoelectricity crystal is used in different area in industry, such as downhole oil, gas industry, and ballistics. The piezoelectricity crystals are able to create electric fields due to mechanical deformation called the direct piezoelectric effect, or create mechanical deformation due to the effect of electric field called the indirect piezoelectric effect. In this thesis, piezoelectricity effect is the core part. There are 4 parts in the frequency output pressure transducer: two crystal oscillators, phase-locked loop (PLL), mixer, frequency counter. Crystal oscillator is used to activate the piezoelectricity crystal which is made from quartz. The resonance frequency of the piezoelectricity crystal will be increased with the higher pressure applied. The signal of the resonance frequency will be transmitted to the PLL. The function of the PLL is detect the frequency change in the input signal and makes the output of the PLL has the same frequency and same phase with the input signal. The output of the PLL will be transmitted to a Mixer. The mixer has two inputs and one output. One input signal is from the pressure crystal oscillator and another one is from the reference crystal oscillator. The frequency difference of the two signal will transmitted to the …

My thesis is to understand the concept of compressive sensing algorithms. Compressive sensing will be a future alternate technique for the Nyquist rate, specific to some applications where sparsity property plays a major role. Software implementation of compressive sensing (CS) takes more time to reconstruct a signal from CS measurements, so we use the orthogonal matching pursuit and basis pursuit algorithms. We have used an image size of 256x256 is used for reconstruction and also implemented a field-programmable gate array (FPGA) of the orthogonal matching pursuit using an image.

Unmanned aerial systems (UASs) have a great potential to enhanced situational awareness in public safety operations. Many UASs operating in the same airspace can cause mid-air collisions. NASA and the FAA are developing a UAS traffic management (UTM) system, which could be used in public safety operations to manage the UAS airspace. UTM relies on an existing communication backhaul, however natural disasters may disrupt existing communications infrastructure or occur in areas where no backhaul exists. This thesis outlines a robust communications alternative that interfaces a fleet of UASs with a UTM service supplier (USS) over a mesh network. Additionally, this thesis outlines an algorithm for vehicle-to-vehicle discovery and communication over the mesh network.

Group testing is all about identifying properties of a set of elements by testing them.

Air corridors are an integral part of the advanced air mobility infrastructure. They are the virtual highways in the sky for transportation of people and cargo in the controlled airspace at an altitude of around 1000 ft. to 2000 ft. above the ground level. This paper presents fundamental insights into the design of air corridors with high operational efficiency as well as zero collisions. It begins with the definitions of air cube, skylane or track, intersection, vertiport, gate, and air corridor. Then, a multi-layered air corridor model is proposed. Traffic at intersections is analyzed in detail with examples of vehicles turning in different directions. The concept of capacity of an air corridor is introduced along with the nature of distribution of locations of vehicles in the air corridor and collision probability inside the corridor are discussed. Finally, the results of simulations of traffic flows are presented.

Sensors have been an integral part of our life since a long time. Traditionally, the transmit information to a data collection center through a physical wire. However, with the introduction of Bluetooth Low Energy (BLE) communication protocol, more research is being done into the field of wireless sensor networks (WSN). BLE was introduced to target low power applications. The CC2650 Launchpad designed by Texas Instruments (TI) can lead to a bulky final product. The aim was to design hardware for the CC2650 micro-controller with the aim of making it more compact for use in WSNs. A top-down approach was used wherein the available product is studied to identify the redundant and reverse engineer it to design a new product. A 2 layer printed circuit board (PCB) was designed which resulted in a 64 percent decrease in size compared to the Launchpad. Also, experiments were performed to test the proof of concept.

This dissertation focuses on the path planning of unmanned aerial vehicle (UAV) swarms under distributed and hybrid control scenarios. It presents two such models and analyzes them both from theory and practice. In the first method, a distributed formation control strategy for UAV swarm based on consensus law is presented. This model makes use of the fundamental concepts of leader-follower structure, social potential functions, and algebraic graph theory to jointly address flocking and de-confliction in the formation control problem. The impact of network topology on formation control is analyzed. It is shown that the degree distribution of the network representing the multi-agent system defines the rate at which formation is attained. Conditions for convergence and stability are derived. In the second method, a hybrid framework for path planning and coverage area by UAV swarms is presented. This strategy significantly improves the current labor-intensive and resource-constraint operations in aquaculture farms. To monitor the farms periodically, an optimized back-and-forth flight path based on the Shamos algorithm is utilized. A trajectory tracking strategy for UAV swarms under uncertain wind conditions is presented.

Since its invention, phased array has been extensively applied in both military and civil areas. The applications include target detecting and tracking, space probe communication, broadcasting, human-machine interfaces, and remote sensing. Although the phased array applications show a broad range of potential market, there are some limitations of phased array's development: high cost, complex structure, narrow bandwidth, and high power consumption. Therefore, novel ideas are needed to reduce these constraints. In this thesis, several new approaches about the design and application of phased array are presents. First, the principle of phased array and fundamental design equations are introduced. Second, a new application of phased array antenna for radar respiration measurement is presented. By integrating a 4×4 Butler matrix with four-element antenna array, there will be four distinct main beams in radiation pattern. This new approach can improve the measurement accuracy and realize a high detecting rate. Third, a compact phased array antenna system based on dual-band operations is introduced. Dual-band function can make N-antenna system obtain 2N unique radiation beams (N is an integer) and achieve a significant size reduction compared to the conventional single-band system. To verify the design concept, a four-element phased array antenna working at 5GHz and …

This dissertation presents beamforming designs. Using novel techniques and methods, the performance of the beamforming is improved on dual-band, tri-band, flexible function, tunable function in THz, and dynamic controllability on incident wave.

This thesis dissertation mainly compares and investigates laboratory study of different implementation methodologies of applied control systems and how they can be adopted in industrial, as well as commercial, automation applications. Namely the research paper aims to assess or evaluate eventual feedback control loops' performance and robustness over multiple conventional or state-of-the-art technologies in the field of applied industrial automation and instrumentation by implementing a laboratory case study setup: the ball on beam system. Hence, the paper tries to close the gap between industry and academia by: first, conducting a historical study and background information of main evolutional and technological eras in the field of industrial process control automation and instrumentation. Then, some related basic theoretical as well as practical concepts are reviewed in Chapter 2 of the report before displaying the detailed design. After that, the next Chapter, analyses the ball on beam control system problem as the case studied in the context of this research through reviewing previous literature, modeling and simulation. The following Chapter details the proposed design and implementation of the ball on beam case study as if it is under the introduced distributed industrial automation architecture. Finally, Chapter 5 concludes this work by listing several …