Training autonomous agents that are capable of performing their assigned job without fail is the ultimate goal of deep reinforcement learning. This thesis introduces a dueling Quantile Regression Deep Q-network, where the network learns the state value quantile function and advantage quantile function separately. With this network architecture the agent is able to learn to control simulated robots in the Gazebo simulator. Carefully crafted reward functions and state spaces must be designed for the agent to learn in complex non-stationary environments. When trained for only 100,000 timesteps, the agent is able reach asymptotic performance in environments with moving and stationary obstacles using only the data from the inertial measurement unit, LIDAR, and positional information. Through the use of transfer learning, the agents are also capable of formation control and flocking patterns. The performance of agents with frozen networks is improved through advice giving in Deep Q-networks by use of normalized Q-values and majority voting.

Unmanned aerial systems (UASs) have a great potential to enhanced situational awareness in public safety operations. Many UASs operating in the same airspace can cause mid-air collisions. NASA and the FAA are developing a UAS traffic management (UTM) system, which could be used in public safety operations to manage the UAS airspace. UTM relies on an existing communication backhaul, however natural disasters may disrupt existing communications infrastructure or occur in areas where no backhaul exists. This thesis outlines a robust communications alternative that interfaces a fleet of UASs with a UTM service supplier (USS) over a mesh network. Additionally, this thesis outlines an algorithm for vehicle-to-vehicle discovery and communication over the mesh network.

Deep reinforcement learning is an area of research that has blossomed tremendously in recent years and has shown remarkable potential in computer games. Real-time strategy game has become an important field of artificial intelligence in game for several years. This paper is about to introduce a kind of algorithm that used to train agents to fight against computer bots. Not only because games are excellent tools to test deep reinforcement learning algorithms for their valuable insight into how well an algorithm can perform in isolated environments without the real-life consequences, but also real-time strategy games are a very complex genre that challenges artificial intelligence agents in both short-term or long-term planning. In this paper, we introduce some history of deep learning and reinforcement learning. Then we combine them with StarCraft. PPO is the algorithm which have some of the benefits of trust region policy optimization (TRPO), but it is much simpler to implement, more general for environment, and have better sample complexity. The StarCraft environment: Blood War Application Programming Interface (BWAPI) is open source to test. The results show that PPO can work well in BWAPI and train units to defeat the opponents. The algorithm presented in the thesis is …

This thesis presents a multi-stage rectifier for wireless power transfer in biomedical implant systems. The rectifier is built using Schottky diodes. The design has been simulated in 0.5µm and 130nm CMOS processes. The challenges for a rectifier in a wireless power transfer systems are observed to be the efficiency, output voltage yield, operating frequency range and the minimum input voltage the rectifier can convert. The rectifier outperformed the contemporary works in the mentioned criteria.

DC to DC converters stabilize the voltage obtained from voltage sources such as solar power system, wind energy sources, wave energy sources, rectified voltage from alternators, and so forth. Hence, the need for improving its control algorithm is inevitable. Many algorithms are applied to DC to DC converters. This thesis designs fuzzy adaptive dynamic programming (Fuzzy ADP) algorithm. Also, this thesis implements both adaptive dynamic programming (ADP) and Fuzzy ADP on DC to DC converters to observe the performance of the output voltage trajectories.

This thesis aims to utilize data analysis and predictive modeling techniques and apply them in different domains for gaining insights. The topics were chosen keeping the same in mind. Analysis of customer interests is a crucial factor in present marketing trends and hence we worked on twitter data which is a significant part of digital marketing. Neuroscience, especially psychological behavior, is an important research area. We chose eye tracking data based on which we differentiated human concentration while watching controllable (video game) videos and uncontrollable (sports) videos. Currently, cities are using data analysis for becoming smart cities. We worked on the City of Lewisville emergency services data and predicted the vehicle-accident-prone areas for development of precautionary measures in those areas.

Today, there is a growing number of buildings in a neighborhood and business parks that are utilizing renewable energy generation, to reduce their electric bill and carbon footprint. The most current way of implementing a renewable energy generation is to use solar panels or a windmill to generate power; then use a charge controller connected to a battery bank to store power. Once stored, the user can then access a clean source of power from these batteries instead of the main power grid. This type of power structure is utilizing a single module system in respect of one building. As the industry of renewable power generation continues to increase, we start to see a new way of implementing the infrastructure of the power system. Instead of having just individual buildings generating power, storing power, using power, and selling power there is a fifth step that can be added, sharing power. The idea of multiple buildings connected to each other to share power has been named a microgrid by the power community. With this ability to share power in a microgrid system, a catastrophic event which cause shutdowns of power production can be better managed. This paper then discusses the data …

One of the challenges of utilizing higher frequencies in the RF spectrum, for any number of applications, is the hardware constraints of analog-to-digital converters (ADCs). Since mid-20th century, we have accepted the Nyquist-Shannon Sampling Theorem in that we need to sample a signal at twice the max frequency component in order to reconstruct it. Compressive Sampling (CS) offers a possible solution of sampling sub-Nyquist and reconstructing using convex programming techniques. There has been significant advancements in CS research and development (more notably since 2004), but still nothing to the advantage of everyday use. Not for lack of theoretical use and mathematical proof, but because of no implementation work. There has been little work on hardware in finding the realistic constraints of a working CS system used for digital signal process (DSP). Any parameters used in a system is usually assumed based on stochastic models, but not optimized towards a specific application. This thesis aims to address a minimal viable platform to implement compressive sensing if applied to a wireless sensor network (WSN), as well as address certain parameters of CS theory to be modified depending on the application.

This thesis presents the implementation of some of the basic concepts of digital logic design in a fun and creative way with the help of paper electronics. This involves circuit building on paper using conductive tape or conductive ink and circuit components as electronics craft materials. Paper electronics toolkit called circuit sticker microcontroller which is deployed by a company named Chibitronics and AT89C51 microcontroller were used for the computational functioning of the circuits built on paper. This can be used to teach the fundamentals of digital logic design to the students in their early stage of studies in an attractive way and can help them them gain a better understanding. This thesis can also be helpful in grabbing the attention of high school students and motivate them towards choosing the engineering discipline for their higher studies.

Wireless sensor networks are an indispensable tool in this highly connected world. WSNs have been the focus of research efforts in areas of communication, electronics and control for many years. Advancements in the fields of MEMS, RF and digital circuit technology has led to the development of low cost and extremely power efficient smart sensors. This has led to the need of a fast, reliable and inexpensive method of consensus building for these sensor networks. Basic concepts of graph theory and consensus building are explained in this thesis. This thesis reviews the models and strategies for consensus building present in the literature. The shortcomings of these models are explained through examples and a leader-follower model based consensus building strategy is presented. Algorithm to convert any graph into a bipartite graph by edge removal and a strategy to select effective leaders based on a weighted combination of node centrality, ratio of leaders to the total number of nodes and presence of leaf nodes in the group is presented in this thesis. Proposed leader-follower model is compared against classic models for consensus building are compared and proven to be better. Mobility is studied using deterministic and random mobility models to show the …

This thesis proposes a design of a rapidly deployable cellular network prototype that provides voice and data communications and it is interoperable with legacy devices and the existing network infrastructure. The prototype is based on software defined radio and makes use of IEEE 802.11 unlicensed wireless radio frequency (RF) band for backhaul link and an open source GSM implementation software. The prototype is also evaluated in environments where there is limited control of the radio frequency landscape, and using Voice Over Internet Protocol (VoIP) performance metrics to measure the quality of service. It is observed that in environments where the IEEE 802.11 band is not heavily utilized, a large number of calls are supported with good quality of service. However, when this band is heavily utilized only a few calls can be supported as the quality of service rapidly degrades with increasing number of calls, which is due to interference. It is concluded that in order to achieve tolerable voice quality, unused licensed spectrum is needed for backhaul communication between base stations.

In game based learning, motivating the players to learn by providing them a desirable gameplay experience is extremely important. However, it's not an easy task considering the quality of today's commercial non-educational games. Throughout the gameplay, the player should neither get overwhelmed nor under-challenged. The best way to do so is to monitor the player's actions in the game because these actions can tell the reason behind the player's performance. They can also tell about the player's lacking competencies or knowledge. Based on this information, in-game educational interventions in the form of hints can be provided to the player. The success of such games depends on their interactivity, motivational outlook and thus player retention. UNTANGLED is an online mapping game based on crowd-sourcing, developed by Reconfigurable Computing Lab, UNT for the mapping problem of CGRAs. It is also an educational game for teaching the concepts of reconfigurable computing. This thesis performs qualitative comparative analysis on gameplays of low performing players of UNTANGLED. And the implications of this analysis are used to provide recommendations for improving the gameplay experience for these players by guiding them. The recommendations include strategies to reach a high score and a compact solution, hints in the …

Mobile wireless sensor networks are not widely implemented in the real world, even after years of research carried out in this field. One reason is the lack of understanding of the impact that mobility has on network performance. The simulation and emulation of mobile wireless sensor networks is necessary before they are deployed for the real-world applications. This thesis presents a simulation-based study of different mobility models. The total area coverage that depends on the pattern of node movements is observed through simulations. The spatial distribution of node locations is also studied. Various synthetic mobility models available are explored based on their theoretical descriptions. ‘BonnMotion' is used as the network simulator for investigating different mobility scenarios. The results obtained after simulations are imported to MATLAB and the analysis of node movements is done through various plots and inferences from the data. The comparison of mobility models is also discussed based on their spatial node distribution in the simulated scenarios.

Decision making can be a complicated process involving perception of the present situation, past experience and knowledge necessary to foresee a better future. This cognitive process is one of the essential human ability that is required from everyday walk of life to making major life choices. Although it may seem ambiguous to translate such a primitive process into quantifiable science, the goal of this thesis is to break it down to signal processing and quantifying the thought process with prominence of EEG signal power variance. This paper will discuss the cognitive science, the signal processing of brain signals and how brain activity can be quantifiable through data analysis. An experiment is analyzed in this thesis to provide evidence that theta frequency band activity is associated with stress and stress is negatively correlated with concentration and problem solving, therefore hindering decision making skill. From the results of the experiment, it is seen that theta is negatively correlated to delta and beta frequency band activity, thus establishing the fact that stress affects internal focus while carrying out a task.

Data acquisition through wireless sensor networks (WSNs) has enormous potential for scalable, distributed, real-time observations of monitored environmental parameters. Despite increasing versatility and functionalities, one critical factor that affects the operation of WSNs is limited power. WSN sensor nodes are usually battery powered, and therefore the long-term operation of the WSN greatly depends on battery capacity and the node's power consumption rate. This thesis focuses on WSN node design to reduce power consumption in order to achieve sustainable power supply. For this purpose, this thesis proposes a Moteino-based WSN node and an energy efficient duty cycle that reduces current consumption in standby mode using an enhanced watchdog timer. The nodes perform radio communication at 915 MHz, for short intervals (180ms) every 10 minutes, and consume 6.8 mA at -14dBm. For testing, the WSN node monitored a low-power combined air temperature, relative humidity, and barometric pressure sensor, together with a typical soil moisture sensor that consumes more power. Laboratory tests indicated average current consumption of ~30µA using these short radio transmission intervals. After transmission tests, field deployment of a star-configured network of nine of these nodes and one gateway node provides a long-term platform for testing under rigorous conditions. A webserver …

In wireless communication systems, one of the most important resources being focused on all the researchers is spectrum. A cognitive radio (CR) system is one of the efficient ways to access the radio spectrum opportunistically, and efficiently use the available underutilized licensed spectrum. Spectrum utilization can be significantly enhanced by developing more applications with adopting CR technology. CR systems are implemented using a radio technology called software-defined radios (SDR). SDR provides a flexible and cost-effective solution to fulfil the requirements of end users. We can see a lot of innovations in Internet of Things (IoT) and increasing number of smart devices. Hence, a CR system application involving an IoT device is studied in this thesis. Opportunistic spectrum access involves two tasks of CR system: spectrum sensing and dynamic spectrum access. The functioning of the CR system is rest upon the spectrum sensing. There are different spectrum sensing techniques used to detect the spectrum holes and a few of them are discussed here in this thesis. The simplest and easiest to implement energy detection spectrum sensing technique is used here to implement the CR system. Dynamic spectrum access involves different models and strategies to access the spectrum. Amongst the available models, …

Computer hardware and algorithm design have seen significant progress over the years. It is also seen that there are several domains in which humans are more efficient than computers. For example in image recognition, image tagging, natural language understanding and processing, humans often find complicated algorithms quite easy to grasp. This thesis presents the different case studies to learn human mapping strategy to solve the mapping problem in the area of coarse-grained reconfigurable architectures (CGRAs). To achieve optimum level performance and consume less energy in CGRAs, place and route problem has always been a major concern. Making use of human characteristics can be helpful in problems as such, through pattern recognition and experience. Therefore to conduct the case studies a computer mapping game called UNTANGLED was analyzed as a medium to convey insights of human mapping strategies in a variety of architectures. The purpose of this research was to learn from humans so that we can come up with better algorithms to outperform the existing algorithms. We observed how human strategies vary as we present them with different architectures, different architectures with constraints, different visualization as well as how the quality of solution changes with experience. In this work all …

Environmental factors can have a significant impact on an individual's health and well-being, and a primary characteristic of environments is air quality. Air sensing equipment is available to the public, but it is often expensive,stationary, or unusable for persons without technical expertise. The goal of this project is to develop an inexpensive and portable sensor module for public use. The system is capable of measuring temperature in Celsius and Fahrenheit, heat index, relative humidity, and carbon dioxide concentration. The sensor module, referred to as the "sniffer," consists of a printed circuit board that interconnects a carbon dioxide sensor, a temperature/humidity sensor, an Arduino microcontroller, and a Bluetooth module. The sniffer is small enough to be worn as a pendant or a belt attachment, and it is rugged enough to consistently collect and transmit data to a user's smartphone throughout their workday. The accompanying smartphone app uses Bluetooth and GPS hardware to collect data and affix samples with a time stamp and GPS coordinates. The accumulated sensor data is saved to a file on the user's phone, which is then examined on a standard computer.

As science and technology continue to advance, innovative developments in transportation can enhance product safety and security for the benefit and welfare of society. The federal government requires every commercial truck to be inspected before each trip. This pre-trip inspection ensures the safe mechanical condition of each vehicle before it is used. An Unmanned Aerial Vehicle (UAV) could be used to provide an automated inspection, thus reducing driver workload, inspection costs and time while increasing inspection accuracy. This thesis develops a primary component of the algorithm that is required to implement UAV pre-trip inspections for commercial trucks using an android-based application. Specifically, this thesis provides foundational work of providing stable height control in an outdoor environment using a laser sensor and an android flight control application that includes take-off, landing, throttle control, and real-time video transmission. The height algorithm developed is the core of this thesis project. Phantom 2 Vision+ uses a pressure sensor to calculate the altitude of the drone for height stabilization. However, these altitude readings do not provide the precision required for this project. Rather, the goal of autonomously controlling height with great precision necessitated the use of a laser rangefinder sensor in the development of the …

The thesis represents the design for dual-band quarter wavelength and half wavelength microstrip transmission line. Chapter 2 proposed the design of a novel dual-band asymmetric pi-shaped short-circuited quarter wavelength microstrip transmission line working at frequencies 1GHz and 1.55 GHz for 50Ω transmission line and at frequencies 1GHz and 1.43GHz for 60Ω transmission line. Chapter 3 proposed the design of a novel dual-band quarter wavelength microstrip transmission line with asymmetrically allocated open stubs and short-circuited stubs working at frequencies 1GHz and 1.32GHz. Chapter 4 proposed the design of dual-band pi-shaped open stub half wavelength microstrip transmission line working at frequencies 1GHz and 2.07GHz. Numerical simulations are performed both in HyperLynx 3D EM and in circuit simulator ADS for all of the proposed designs to measure the return loss (S11) and insertion loss (S12) in dB and phase response for S12 in degree.

The research reported here deals with the early characterization of Parkinson’s disease (PD), the second most common degenerative disease of the human motor system after Alzheimer’s. PD results from the death of dopaminergic neurons in the substantia nigra region of the brain. Its occurrence is highly correlated with the aging population whose numbers increase with the healthcare benefits of a longer life. Observation of motor control symptoms associated with PD, such as gait and speech analysis, is most often used to evaluate, detect, and diagnose PD. Since speech and some delicate motor functions have provided early detection signs of PD, reliable analysis of these features is a promising objective diagnostic technique for early intervention with any remedial measures. We implement and study here three PD diagnostic methods and their correlation between each other’s results and with the motor functions in subjects diagnosed with and without PD. One initial test documented well in the literature deals with feature analysis of voice during phonation to determine dysphonia measures. Features of the motor function of two fingers were extracted in tests titled “Motor function of alternating finger tapping on a computer keyboard” and “Motor function of the index and thumb finger tapping with …

Multi band technology helps in getting multiple operating frequencies using a single microwave device. This thesis presents the design of dual and tri band microwave devices using coupled transmission line structures. Chapter 2 presents the design of a novel dual band transmission line structure using coupled lines. In chapter 3, Design of a dual band branch line coupler and a dual band Wilkinson power divider are proposed using the novel dual band transmission line structure presented in the previous chapter. In chapter 4, Design of a tri band transmission line structure by extending the dual band structure is presented. The Conclusion and future work are presented in chapter 5.

In situations where information infrastructure is destroyed or not available, on-demand information infrastructure is pivotal for the success of rescue missions. In this paper, a drone-carried on demand information infrastructure for long-distance WiFi transmission system is developed. It can be used in the areas including emergency response, public event, and battlefield. The WiFi network can be connected to the Internet to extend WiFi access to areas where WiFi and other Internet infrastructures are not available. In order to establish a local area network to propagate WIFI service, directional antennas and wireless routers are used to create it. Due to unstable working condition on the flying drones, a precise heading turning stage is designed to maintain the two directional antennas facing to each other. Even if external interferences change the heading of the drones, the stages will automatically rotate back to where it should be to offset the bias. Also, to maintain the same flying altitude, a ground controller is designed to measure the height of the drones so that the directional antennas can communicate to each other successfully. To verify the design of the whole system, quite a few field experiments were performed. Experiments results indicates the design is reliable, …

This thesis presents the design of a communication system (PRCS) which improves on all aspects of the current state of the art 4G communication system Long Term Evolution (LTE) including peak to average power ratio (PAPR), data reliability, spectral efficiency and complexity using the most recent state of the art research in the field combined with novel implementations. This research is relevant and important to the field of electrical and communication engineering because it provides benefits to consumers in the form of more reliable data with higher speeds as well as a reduced burden on hardware original equipment manufacturers (OEMs). The results presented herein show up to a 3 dB reduction in PAPR, less than 10-5 bit errors at 7.5 dB signal to noise ratio (SNR) using 4QAM, up to 3 times increased throughput in the uplink mode and 10 times reduced channel coding complexity.