Data Analysis Process – Udacity

Power Plant df_powerplant = pd.read_csv('powerplant_data.csv') labels = ['Temperature', 'Exhaust Vacuum', 'Ambient Pressure', 'Relative Humidity', 'Net hourly electrical energy output'] df_powerplant = pd.read_csv('powerplant_data.csv', header=0, names=labels) df_powerplant.head() df_powerplant.to_csv('powerplant_data_edited.csv', index=False)   Assessing and Building Intuition Once you have your data loaded into dataframes, Pandas makes a quick investigation of the data really easy. Let's explore some helpful methods for assessing and building intuition about a dataset. We can use the cancer data from before to help us. import pandas as pd df = pd.read_csv('cancer_data.csv') df.head() # this returns a tuple of the dimensions of the dataframe df.shape # this returns the datatypes of the columns df.dtypes # although the datatype for diagnosis appears to be object, further # investigation shows it's a string…

Continue Reading

Introduction to the Python Standard Library – Udacity

Our favourite modules The Python Standard Library has a lot of modules! To help you get familiar with what's available, here are a selection of our favourite Python Standard Library modules and why we use them! csv: very convenient for reading and writing csv files collections: useful extensions of the usual data types including OrderedDict, defaultdict and namedtuple random: generates pseudo-random numbers, shuffles sequences randomly and chooses random items string: more functions on strings. This module also contains useful collections of letters like string.digits (a string containing all characters with are valid digits). re: pattern-matching in strings via regular expressions math: some standard mathematical functions os: interacting with operating systems os.path: submodule of os for manipulating path names sys: work directly with the Python interpreter json: good for…

Continue Reading

The 5 Elements of Effective Thinking

The 5 Elements of Effective Thinking
The 5 Elements of Effective Thinking by Edward B. Burger and Michael Starbird Read:  2018-01-29, Rating:  9/10. This book offers thought-provoking ways to provoke thought. I know quite certainly that I myself have no special talent. Curiosity, obsession and dogged endurance, combined with self-criticism, have brought me to my ideas. —Albert Einstein Understand deeply: Don’t face complex issues head-on; first understand simple ideas deeply. Clear the clutter and expose what is really important. Be brutally honest about what you know and don’t know. Then see what’s missing, identify the gaps, and fill them in. Let go of bias, prejudice, and preconceived notions. There are degrees to understanding (it’s not just a yes-or-no proposition) and you can always heighten yours. Rock-solid…

Continue Reading

Little Bets

Little Bets
by Peter Sims Read:  2018-01-19, Rating:  5/10. You can't put into a spreadsheet how people are going to behave around a new product. Jeff Bezos will say David Galenson Two types of Innovators: Conceptual - Mozart, bold new ideas, breakthroughs early in life Experiential innovation - experimental, iterative, trial and error, persistence, accept failures and setbacks Entrepreneurs and MBA trained managers use two different approaches when doing something new Experiment Play Immerse Define Reorient Iterate Cofounder Bill Hewlett loved to make what he called small bets to uncovered unpredictable opportunities Calculator HP35 Seasoned entrepreneurs will tend to determine in advance what why're willing to lose rather than to calculate expected gains. Affordable loss principle The subject of affordable losses highlights…

Continue Reading

One Small Step Can Change Your Life

the kaizen way
The Kaizen Way by Robert Maurer Read:  2018-01-07, Rating:  7/10. using very small steps to improve a habit, a process, or product using very small moments to inspire new products and inventions A journey of a thousand miles must begin with the first step.” —Lao Tzu Kaizen and innovation are the two major strategies people use to create change. Where innovation demands shocking and radical reform, all kaizen asks is that you take small, comfortable steps toward improvement. These strategies include: asking small questions to dispel fear and inspire creativity thinking small thoughts to develop new skills and habits—without moving a muscle taking small actions that guarantee success solving small problems, even when you’re faced with an overwhelming crisis bestowing…

Continue Reading

How Not to Be Wrong

The Power of Mathematical Thinking
The Power of Mathematical Thinking by Jordan Ellenberg Read:  2018-01-02, Rating:  6/10. I wanted to like this book, but some concepts are explained in brief and others are strung out without conclusions. The title is misleading. This book is more about the power of mathematical thinking than how not to be wrong. My Notes: WHEN AM I GOING TO USE THIS? Math is a science of not being wrong about things, its techniques and habits hammered out by centuries of hard work and argument. With the tools of mathematics in hand, you can understand the world in a deeper, sounder, and more meaningful way. ABRAHAM WALD AND THE MISSING BULLET HOLES A mathematician is always asking, “What assumptions are you…

Continue Reading

So Good They Can’t Ignore You

So Good They Can't Ignore You Cover
Why Skills Trump Passion in the Quest for Work You Love by Cal Newport Read:  2017-12-16, Rating:  8/10. The Four Rules: Don't Follow Your Passion - Passion Is Rare. Importance of Skill - Most any work can become the foundation for a compelling career. Importance of Control - Enthusiasm alone is not rare and valuable and is therefore not worth much in terms of career capital. Importance of Mission - A good career mission is similar to a scientific breakthrough—it’s an innovation waiting to be discovered in the adjacent possible of your field. Rule #1 Don't Follow Your Passion Steve Martin quote, “so good that they can’t ignore you.” The “Passion” of Steve Jobs The Passion Hypothesis The key to occupational happiness is…

Continue Reading

SQL Basics Recap – Udacity

Recap Commands You have already learned a lot about writing code in SQL! Let's take a moment to recap all that we have covered before moving on: Statement How to Use It Other Details SELECT SELECT Col1, Col2, ... Provide the columns you want FROM FROM Table Provide the table where the columns exist LIMIT LIMIT 10 Limits based number of rows returned ORDER BY ORDER BY Col Orders table based on the column. Used with DESC. WHERE WHERE Col > 5 A conditional statement to filter your results LIKE WHERE Col LIKE '%me% Only pulls rows where column has 'me' within the text IN WHERE Col IN ('Y', 'N') A filter for only rows with column of 'Y' or 'N' NOT WHERE Col NOT IN ('Y', "N') NOT is frequently…

Continue Reading