This lesson is still being designed and assembled (Pre-Alpha version)

DeapSECURE module 4: Deep Learning (Neural Network)

Key Points

Introduction to Machine Learning & Deep Learning
  • Deep learning is an advanced form of machine learning that uses neural networks, which mimic the neurons in the human brain, to collect data, learn and modify the model as it learns more.

Deep Learning to Identify Smartphone Applications
  • Malicious apps (malware) have become a prevalent tool for compromising mobile devices, stealing personal information, or spying on a user’s activities.

  • Researchers have leveraged artificial intelligence (AI) / machine learning (ML) to keep up with increasing security challenges.

  • Large amounts of data are critical to train and validate accurate and effective ML-based cybersecurity techniques.

  • ML models can be used to distinguish smartphone apps and potentially identify malware.

Overview of Deep Neural Network Concepts
  • Deep neural networks basically have linear and nonlinear parts.

  • Backpropagation is used to adjust the network parameters.

  • An HPC can be adopted to speed up the training and inference processes.

An Introduction to Keras with Binary Classification Task
  • Keras is an easy-to-use high-level API for building neural networks.

  • Main parts of a neural network layer: number of hidden neurons, activation function.

  • Main parts of a neural network model: layers, optimizer, learning rate, loss function, performance metrics.

Classifying Smartphone Apps with Keras
  • On KERAS, we can easily build the network by defining the layers and connecting them together.

Tuning Neural Network Models for Better Accuracy
  • Neural network models are tuned by tweaking the architecture and tuning the training hyperparameters.

  • How scripting works by converting the notebook to job scripts

Using Multicore CPUs or GPUs for KERAS Computation
  • First key point. Brief Answer to questions. (FIXME)

Deep Learning in the Real World
  • Layer design

Glossary

variance
A path that refers to a particular location in a file system. Absolute paths are usually written with respect to the file system’s FIXME

Further Reading

Building neural networks

“Pipelines, Mind Maps and Convolutional Neural Networks” https://towardsdatascience.com/pipelines-mind-maps-and-convolutional-neural-networks-34bfc94db10c

This article describes the discipline that a data scientist exerted over himself and his impulses so that he could get to his end-goal more efficiently.

He was using a “mind map” to help keep track what one has done in changing network, etc. (as well as the effect of each change) to achieve a better-performing network.