Project list | rael.io

yodo

Mon, 26 Aug 2019 11:23:56 +0200

Simple GoLang TODO application

This application is just a playground to learn:

TDD with GoLang
github.com/spf13/cobra
github.com/spf13/viper
gopkg.in/yaml.v2
GitHub Actions
```
$ go build
```

$ ./yodo get
default:
Empty list

$ ./yodo add Add verbose mode
add task "Add verbose mode" (false) to file$

$ ./yodo get
default:
- [0] "Add verbose mode" (false)

$ ./yodo do 0
Task 0 done.

$ ./yodo get
default:
- [0] "Add verbose mode" (true)

$ cat ~/.yodo/default.yaml
id: 0
name: default
tasks:
- id: 0
status: true
description: Add verbose mode

Notes

Gopher art from ashleymcnamara/gophers.

rael.io

Thu, 15 Aug 2019 11:23:56 +0200

Static site for rael.io using:

cloudnative.barcelona

Wed, 24 Jul 2019 11:23:56 +0200

Cloud Native Barcelona is the official Cloud Native Computing Foundation (CNCF) user group dedicated to building a strong, open, diverse developer community around the Cloud Native platform and technologies in Barcelona.

What is CNCF?

CNCF is an open source software foundation dedicated to making cloud native computing universal and sustainable. Cloud native computing uses an open source software stack to deploy applications as microservices, packaging each part into its own container, and dynamically orchestrating those containers to optimize resource utilization. Cloud native technologies enable software developers to build great products faster.

Learn more at cncf.io.

Docker wordpress

Mon, 04 Mar 2019 11:23:56 +0200

Dockerfile for Wordpress with some plugin/theme management.

Available at gcr.io/raelga/wordpress:latest

Dockerfile

Stage: wp-plugins

Downloads form GitHub the plugins listed in context/plugins.list:

raelga/wp-mailgun:1.7.1
wpCloud/wp-stateless:2.2.6
WP2Static/wp2static:6.6.5

The format is: <github-username>/<github-repo>:<github-tag>.

Stage: wp

Copies the content from context/wp-content
Copies the plugins from the wp-plugins stage to the wp plugins folder.
Adds some php optimizations

Output

docker build -t cms.bigot.es:7c4311f -f cms.bigot.es/Dockerfile cms.bigot.es/context
Sending build context to Docker daemon 3.936MB
Step 1/7 : FROM bash:5.0 as wp-plugins
---> f63c4bf22009
Step 2/7 : ADD plugins.list /tmp/wp-plugins/plugins.list
---> 263f808fe293
Step 3/7 : RUN while read plugin || [ -n "$plugin" ]; do wget -q -O - https://github.com/${plugin/\:*/}/archive/${plugin/*:/}.tar.gz | tar zx -C /tmp/wp-plugins && echo "Plugin ${plugin} downloaded."; done < /tmp/wp-plugins/plugins.list
---> Running in f5217e97b99c
Plugin raelga/wp-mailgun:1.7.1 downloaded.
Plugin wpCloud/wp-stateless:2.2.6 downloaded.
Plugin WP2Static/wp2static:6.6.5 downloaded.
Removing intermediate container f5217e97b99c
---> a639b006aec8
Step 4/7 : FROM wordpress:5.1
---> d3a744e0e523
Step 5/7 : COPY --chown=www-data wp-content /var/www/html/wp-content
---> Using cache
---> 3649a2f4204b
Step 6/7 : COPY --from=wp-plugins --chown=www-data /tmp/wp-plugins /var/www/html/wp-content/plugins/
---> 24191ed6bb75
Step 7/7 : RUN { mv $PHP_INI_DIR/php.ini-production $PHP_INI_DIR/php.ini; echo 'opcache.memory_consumption=64'; echo 'opcache.max_accelerated_files=4000'; echo 'opcache.revalidate_freq=10'; } > /usr/local/etc/php/conf.d/opcache-recommended.ini
---> Running in d1f3bd26f718
Removing intermediate container d1f3bd26f718
---> e86ce9bed1cc
Successfully built e86ce9bed1cc
Successfully tagged cms.bigot.es:7c4311f

Dockerfile.onbuild

The Dockerfile.onbuild builds the gcr.io/raelga/wordpress:latest image with some ONBUILD triggers, to copy the wp-context and download the plugins from the plugins.list on build when used as FROM.

$ cat Dockerfile
FROM gcr.io/raelga/wordpress:latest
$ docker build -t example-wp -f Dockerfile context/
Sending build context to Docker daemon 3.936MB
Step 1/1 : FROM gcr.io/raelga/wordpress:latest
latest: Pulling from raelga/wordpress
27833a3ba0a5: Already exists
2d79f6773a3c: Already exists
f5dd9a448b82: Already exists
95719e57e42b: Already exists
cc75e951030f: Already exists
78873f480bce: Already exists
1b14116a29a2: Already exists
ea69a25cac2e: Already exists
2dbd1202c78e: Already exists
22cefd01eafa: Already exists
21da110f3a63: Already exists
0c1e476df271: Already exists
70a74d14ca92: Already exists
6590e4467d09: Already exists
1b0635fe52ca: Already exists
ccb00f7ad0b4: Already exists
996d17ef73fc: Already exists
2aa80255fade: Already exists
6a6dca4d800a: Already exists
1674e86caa8e: Pull complete
Digest: sha256:e010adc7d5789b75e86e2799bb08e7baec225750d6dce34ef14be2b4ae507d85
Status: Downloaded newer image for gcr.io/raelga/wordpress:latest
# Executing 3 build triggers
---> Running in bdd18a2ac418
######################################################################## 100.0%
Plugin raelga/wp-mailgun:1.7.1 downloaded.
######################################################################## 100.0%
Plugin wpCloud/wp-stateless:2.2.6 downloaded.
######################################################################## 100.0%
Plugin WP2Static/wp2static:6.6.5 downloaded.
Removing intermediate container bdd18a2ac418
---> 3b0c87eb6eb5
Successfully built 3b0c87eb6eb5
Successfully tagged example-wp:latest

gcp.rael.io

Sun, 24 Feb 2019 11:23:56 +0200

Deployment manager deployment from my Google Cloud projects.

dm-templates

Sat, 23 Feb 2019 11:23:56 +0200

Repo for Deployment Manager templates shared between projects.

Overview

The main purpose of this repo is to have a centralized template repository that can be added to any GCP Deployment Manager project as a Git submodule.

That removes the need of copying the templates from one project to another and the risk of ending with different versions of the templates in each project.

Templates

Templates are organized by type of resource:

compute
container
iam
sql
storage
projects

The type matches the main resources of the template, as in most cases will deploy more GCP resources required to configure / use the main one.

The Makefile

The Makefile is useful for the actual deployments, not for managing the templates.

It expects the following folder configuration:

❯ tree -L 2 .
.
├── Makefile
├── deployments
│ ├── bigotes-pro
│ ├── rael-base
│ ├── rshared
│ ├── project-id-3
│ └── project-id-N
└── templates
├── compute
├── container
├── iam
├── project
├── sql
└── storage

For each project, you can have the deployment .yaml manifest in the root folder or using a similar folder hierarchy with folders per each resource type:

deployments/rshared
└── compute
├── bigotes-pro-peering.yaml
└── network.yaml
1 directory, 2 files

With that setup, the makefile will generate a target to:

Create the deployment
Update the deployment
Preview the deployment

For example, with the following tree:

❯ tree deployments
deployments
├── bigotes-pro
│ └── compute
│ └── rshared-peering.yaml
├── rael-base
│ ├── compute
│ │ ├── bigotes-pro-base-peering.yaml
│ │ └── network.yaml
│ └── projects
│ ├── bigotes-pro-project.yaml
│ └── rshared-project.yaml
└── rshared
└── compute
├── bigotes-pro-peering.yaml
└── network.yaml
7 directories, 7 files

Will generate the following targets:

gcp.rael.io/dm on  master [!?] took 17s
❯ make
make target
dm-create-bigotes-pro/compute/rshared-peering dm-preview-rael-base/compute/bigotes-pro-base-peering dm-update-rael-base/compute/network
dm-create-rael-base/compute/bigotes-pro-base-peering dm-preview-rael-base/compute/network dm-update-rael-base/projects/bigotes-pro-project
dm-create-rael-base/compute/network dm-preview-rael-base/projects/bigotes-pro-project dm-update-rael-base/projects/rshared-project
dm-create-rael-base/projects/bigotes-pro-project dm-preview-rael-base/projects/rshared-project dm-update-rshared/compute/bigotes-pro-peering
dm-create-rael-base/projects/rshared-project dm-preview-rshared/compute/bigotes-pro-peering dm-update-rshared/compute/network
dm-create-rshared/compute/bigotes-pro-peering dm-preview-rshared/compute/network gcloud-config-rael-base
dm-create-rshared/compute/network dm-update-bigotes-pro/compute/rshared-peering help
dm-preview-bigotes-pro/compute/rshared-peering dm-update-rael-base/compute/bigotes-pro-base-peering

Examples of this makefile in use:

github.com/raelga/bigot.es
github.com/raelga/gcp.rael.io

Demo

Bigotes

Sun, 11 Nov 2018 11:23:56 +0200

Docker cats

Sun, 11 Nov 2018 11:23:56 +0200

Simple docker images that show an image of a cat, the tag is the cat name:

https://cloud.docker.com/u/raelga/repository/docker/raelga/cats

Use them with:

docker push raelga/cats:cat-name

Kubernetes

Wed, 01 Aug 2018 11:23:56 +0200

Contributing to the Kubernetes project in different special interest groups, mainly focused on community engagement, documentation and user/contributor experience.

Gubernator PR Dashboard

sig-docs

Lead and approver for the Spanish content at kubernetes.io in sig-docs.

sig-contribex

Contributor in sig-contribex by organizing events like talks, workshops or the New Contributors Summits during KubeCon. Also working on initiatives to improve the Kubernetes community and the contributor experience.

Contributor Summits

sig-usability

Contributor in sig-usability to ensure that the Kubernetes project is maximally usable by users of a variety of different backgrounds and abilities.

Usability Special Interest Group

sig-cli

Contributor in sig-cli adding Spanish support to kubectl.

Kubernetes Talks

Wed, 28 Mar 2018 11:23:56 +0200

Talks

Kubernetes 101

The main subject of this talk is to have an overview on the microservices architectures. Then, starts an introduction to the kubernetes architecture, core services and objects: pods, controllers, deployments and sets.

Kubernetes Clouds

The main subject of this talk is viewing the differences between each managed kubernetes solution offered by AWS, Azure and GCP.

For the labs, the main object is having several clusters deployed all over the using each managed (or not) solution and deploy the same application using the common interface provided by Kubernetes.

Providers

Digital Ocean

The main subject of this talk is introducing to the Digital Ocean cloud platform and their Managed Kubernetes solution.

Tools

Traefik

The main subject of this talk is introducing to the Traefik awesome Cloud Native Edge Router and the new features comming in Traefik 2.0.

Study Jams

ReplicaSets

Notes

Gopher art from ashleymcnamara/gophers.

game.pkts.es

Sat, 24 Mar 2018 11:23:56 +0200

Static site for a videogame made with RPG Maker about the pkts community, full of inside jokes.

Site for pkts | The Game

https://game.pkts.es

About

The webpage uses Templated Theory Site Template.

The clock uses wimbarelds/TimeCircles.

Run

The website can be deployed with docker at localhost:8080 using the makefile targets:

Deploy

make run

Will build a container image from nginx:latest with the docs folder copied as nginx document root.

Develop

make dev

Will build a container image from nginx:latest with the docs folder mounted to nginx document root.

Jupyter Image Extractor

Tue, 06 Mar 2018 11:23:56 +0200

Parses a Jupyter book html and extracts the images.

Build

Build the container:

ellie:ws rael$ make docker-build

Expected output:

docker build . -t 'jupyter-image-extractor'
Sending build context to Docker daemon 12.46MB
Step 1/1 : FROM python:3-onbuild
# Executing 3 build triggers
---> Running in be4957e8a2d2
Collecting beautifulsoup4 (from -r requirements.txt (line 1))
Downloading https://files.pythonhosted.org/packages/9e/d4/10f46e5cfac773e22707237bfcd51bbffeaf0a576b0a847ec7ab15bd7ace/beautifulsoup4-4.6.0-py3-none-any.whl (86kB)
Installing collected packages: beautifulsoup4
Successfully installed beautifulsoup4-4.6.0
Removing intermediate container be4957e8a2d2
---> 2b1181b0bde2
Successfully built 2b1181b0bde2
Successfully tagged jupyter-image-extractor:latest

Execute

Run the script with docker:

ellie:ws rael$ make docker-run

Expected output:

docker run -it --rm --name 'jupyter-image-extractor' -v "/Users/rael/Documents/Code/python/ws:/code" -w /code 'jupyter-image-extractor' python jupyterImageSaver.py Jupyter\ Notebook\ Viewer.html
./Jupyter Notebook Viewer_files/nav_logo.svg
./images/base64-img-1.png
./images/base64-img-2.png
./images/base64-img-3.png
./images/base64-img-4.png
./images/base64-img-5.png
./images/base64-img-6.png

Go Playground

Mon, 12 Feb 2018 11:23:56 +0200

Features

Compiles to Machine Code
Design for concurrence
Statically typed
Garbage collected

Language

Variables

https://blog.golang.org/gos-declaration-syntax

Definition

var foo string;
foo = "bar" // OK, new value for foo
foo = 5 // compile error, expected string, found int
newfoo = "bar" // compile error, foo is not defined
bar := "foo" // implicit var

Basic Types

https://golang.org/pkg/go/types/ or go doc types

 Invalid: {Invalid, 0, "invalid type"},
Bool: {Bool, IsBoolean, "bool"},
Int: {Int, IsInteger, "int"},
Int8: {Int8, IsInteger, "int8"},
Int16: {Int16, IsInteger, "int16"},
Int32: {Int32, IsInteger, "int32"},
Int64: {Int64, IsInteger, "int64"},
Uint: {Uint, IsInteger | IsUnsigned, "uint"},
Uint8: {Uint8, IsInteger | IsUnsigned, "uint8"},
Uint16: {Uint16, IsInteger | IsUnsigned, "uint16"},
Uint32: {Uint32, IsInteger | IsUnsigned, "uint32"},
Uint64: {Uint64, IsInteger | IsUnsigned, "uint64"},
Uintptr: {Uintptr, IsInteger | IsUnsigned, "uintptr"},
Float32: {Float32, IsFloat, "float32"},
Float64: {Float64, IsFloat, "float64"},
Complex64: {Complex64, IsComplex, "complex64"},
Complex128: {Complex128, IsComplex, "complex128"},
String: {String, IsString, "string"},
UnsafePointer: {UnsafePointer, 0, "Pointer"},
UntypedBool: {UntypedBool, IsBoolean | IsUntyped, "untyped bool"},
UntypedInt: {UntypedInt, IsInteger | IsUntyped, "untyped int"},
UntypedRune: {UntypedRune, IsInteger | IsUntyped, "untyped rune"},
UntypedFloat: {UntypedFloat, IsFloat | IsUntyped, "untyped float"},
UntypedComplex: {UntypedComplex, IsComplex | IsUntyped, "untyped complex"},
UntypedString: {UntypedString, IsString | IsUntyped, "untyped string"},
UntypedNil: {UntypedNil, IsUntyped, "untyped nil"},

var x byte = 255 // byte alias for uint8
var y byte = x + 5 // overflow to 4
x++ // overflow to 0
var y byte = 0
y = y - 1 // underflow to 255

var foo byte = 2
var foo int32 = 260
sum = foo + bar // compilation error different types
foo = bar // compilation error different types
var conv uint8 = uint8(260) // 4

Arrays

var a [2]int
a[0] = 1
a[1] = "foo" // compile error, wrong type
a[1] = 2 // OK
a[2] = 3 // compile error, out of bounds
index := 2
a[index] = 3 // runtime error, out of bounds
n := 5
var b [n]int // compile error, array size must be constant
var c [2]int // OK
c = a // OK, copy all values
var d [4]int
d = a // compile error, wrong type [2]int vs [4]int

Go will put the array values contiguous in memory adding padding if needed to align with ⁴⁄₈ bytes.

var a [2][2][2]int
0x00 a[0][0][0]
0x01 a[0][0][1]
0x02 a[0][1][0]
0x03 a[0][1][1]
0x04 a[1][0][0]
0x05 a[1][0][1]
0x06 a[1][1][0]
0x07 a[1][1][1]

Slices

TODO

### Structs

type Person struct {
Name string
Age string
Gender string
Children []Person // OK, can be empty, is a slice
Mother Person // compile error, invalid recurse type
Father Person // Type Person contains a Person, infinite references
Parents []Person // OK, can be empty, is a slice
}

### Pointer

var x int = 42
var y *int // pointer to integrer
y = &x // &x returns the pointer to x (address of x)
z := *y // *y derreferences y, gets 42, the value of x
x = 24 // updates x value
z = *y // *y returns the new value of x, 24

Maps

TODO

Definition scope

x := 0
if condition {
x := 42
}
y := x // y is 0
if condition {
y = 21
}
z := y // z is 21

Functions

func foo(x, y int, z bool) int {
if z {
return x + y
} else {
return "bar" // compile error, wrong return type
}
}
func bar() (string, int) {
return "The answer is", 42
}
func main() {
var x int = foo(1, 2, true) // OK
var y int = foo(1, 2) // compile error, wrong number of arguments
var z int = foo(1, 2, "bar") // compile error, last argument not a bool
var v bool = foo(1, 2, true) // compile error, wrong return type
a := 1
b := 2
s := foo(a, b, true) + a // OK, compiler knows that a, b and foo are int
str, num := bar() // OK
}

Syntax

Semicolons are inserted by the compiler

func foo(x int) int {
x++
return x
}
foo(1)

The compiler will put the ;:

func foo(x int) int {
x++;
return x;
};
foo(1);

### Loops

abc := [3]string{"a", "b", "c"}
for i, v := rang abc {
// i is the index or key if abc is a map
// v is the value
}

Range

Resources

Notes

Gopher art from ashleymcnamara/gophers.

Cloud Native Barcelona

Mon, 15 Jan 2018 11:23:56 +0200

Cloud Native Barcelona is the official Cloud Native Computing Foundation user group dedicated to building a strong, open, diverse developer community around the Cloud Native platform and technologies in Barcelona.

Cloud native technologies empower organizations to build and run scalable applications in modern, dynamic environments such as public, private, and hybrid clouds. Containers, service meshes, microservices, immutable infrastructure, and declarative APIs exemplify this approach.

These techniques enable loosely coupled systems that are resilient, manageable, and observable. Combined with robust automation, they allow engineers to make high-impact changes frequently and predictably with minimal toil.

All the communitcation channels and events of the Cloud Native Barcelona user group are governed by the Linux Foundation Code of Conduct. We are committed to making participation in this group a harassment-free experience for everyone, regardless of level of experience, gender, gender identity and expression, sexual orientation, disability, personal appearance, body size, race, ethnicity, age, religion, or nationality.

Feel free to join us at the slack at slack.cloudnative.barcelona.

Want to support Cloud Native Barcelona? Do you have a talk proposal? Please send us details at speak.cloudnative.barcelona, thanks!

tgfwdbot

Sun, 09 Jul 2017 11:23:56 +0200

Bot to forward messages between supergroups and private chats, to allow talking in Telegram supergroups when banned.

Why

Sometimes, due to trolls reporters, users can be banned from any Telegram supergroup, not only the one where reported. With this bot, users will be able to participate in specific groups through the bot.

This bot can be added to the group, identified by TELEGRAM_GROUP_ID, and will:

Forward any message from the Group to the private conversation with the banned user
Forward any message from the private conversation with the banned user to the Group

The admins of the groups where the bot is a member will decide if the allows the banned users to participate or not.

Disclaimer

This bot is not intended to be a tool for spammers and malicious users to bypass Telegram bans. The purpose is to allow users to interact in the groups with the authorization of the group admins when globally banned from supergroups due to troll reportings.

Notes

Gopher art from ashleymcnamara/gophers.

TS Invaders

Sat, 10 Jun 2017 11:23:56 +0200

Yet another spaces invaders clone, this time in TypeScript using Phaser.io.

References

Phaser.io framework from @photonstorm Github

Art

Player explosion sprite from J-Robot OpenGameArt
Rest of the graphic art is from @whiskyemms

PyBot

Thu, 02 Mar 2017 11:23:56 +0200

pybot

Wrapper for python-telegram-bot to allow dynamic plug-in architecture, an attempt to make python-telegram-bot more hubottish.

Execution flow

bin/pybot starts the bot with the selected adapter and using the configuration options defined in conf/pybot.conf or the command-line arguments.
The selected adapter receives the message and sends it to the brain.py.
The brain.py loads in runtime all the .py files in the ./memory folder each time and try to execute a defined method, for example hear(message.text).
Each module in ./memory with that method returns a response, the brain.py sends it to the pybot.py and it sends the response back to the chat.

As the methods are dynamically loaded, you can edit and add the files in ./memory without need to restart pybot.py, and they will be reloaded on the next message. Overkill but funny.

Makefile targets

usage: Show this help
setup-venv: Setup virtualenv
lint: Run code linter to check code style
telegram: Run pybot with the telegram adapter
docker-build: Build the docker image for running pybot
docker-telegram: Run with telegram adapter in the docker container
docker-lint: Run pep8 in the docker container
docker-clean: Remove the docker image

Execution example

make docker-telegram

docker run -it --rm --name pybot -v /Users/rael/Code/python/pybot:/usr/src/pybot -w /usr/src/pybot 'pybot' bin/pybot telegram
Starting pybot using conf token file. CTRL-C to quit.
2017-04-17 07:35:54,392 - pybot.interfaces.telegram - INFO - Bot raelbot up and ready!
2017-04-17 07:36:39,371 - pybot.brain - INFO - 116133952, Hello world!, 53693428, 2017-04-17 07:36:39,"53693428";

Contributing

Contributions of all sizes are welcome.

Attributions

Header image from python-telegram-bot.org

License

You may copy, distribute and modify the software provided that modifications are described and licensed for free under GNU General Public License v3.0. Derivatives works (including modifications or anything statically linked to the library) can only be redistributed under LGPL-3, but applications that use the library don’t have to be.

Hubot Raelbot

Sun, 16 Aug 2015 11:23:56 +0200

raelbot is a chat bot built on the Hubot framework.

Running raelbot Locally

You can test your hubot by running the following, however some plugins will not behave as expected unless the environment variables they rely upon have been set.

You can start raelbot locally by running:

% bin/hubot

You’ll see some start up output and a prompt:

[Sat Feb 28 2015 12:38:27 GMT+0000 (GMT)] INFO Using default redis on localhost:6379
raelbot>

Then you can interact with raelbot by typing raelbot help.

raelbot> raelbot help
raelbot help - Displays all of the help commands that raelbot knows about.
...

Persistence

If you are going to use the hubot-redis-brain package (strongly suggested), you will need to add the Redis to Go addon on Heroku which requires a verified account or you can create an account at Redis to Go and manually set the REDISTOGO_URL variable.

% heroku config:add REDISTOGO_URL="..."

If you don’t need any persistence feel free to remove the hubot-redis-brain from external-scripts.json and you don’t need to worry about redis at all.

Adapters

Adapters are the interface to the service you want your hubot to run on, such as Campfire or IRC. There are a number of third party adapters that the community have contributed. Check Hubot Adapters for the available ones.

If you would like to run a non-Campfire or shell adapter you will need to add the adapter package as a dependency to the package.json file in the dependencies section.

Once you’ve added the dependency with npm install --save to install it you can then run hubot with the adapter.

% bin/hubot -a <adapter>

Where <adapter> is the name of your adapter without the hubot- prefix.

Deploying to UNIX or Windows

If you would like to deploy to either a UNIX operating system or Windows. Please check out the deploying hubot onto UNIX and deploying hubot onto Windows wiki pages.

GTA Crew Exporter

Wed, 06 Nov 2013 11:23:56 +0200

Overview

Get information about crew members on Rockstar GTAV social club.

Prerequisites

python | http://www.python.org/download/
selenium for python | https://pypi.python.org/pypi/selenium
firefox | http://www.mozilla.org/en-US/firefox/new/

** Firefox must be in english due to Rockstar Social Club source code, in the final version it will not be necessary. **

Installation

Linux

[327] root@eva:~# aptitude install python-pip
The following NEW packages will be installed:
python-pip python-pkg-resources{a} python-setuptools{a}
0 packages upgraded, 3 newly installed, 0 to remove and 18 not upgraded.
Need to get 648 kB of archives. After unpacking 2,938 kB will be used.
Do you want to continue? [Y/n/?] y
Get: 1 http://ftp.es.debian.org/debian/ jessie/main python-pkg-resources all 0.6.49-2 [62.5 kB]
Get: 2 http://ftp.es.debian.org/debian/ jessie/main python-setuptools all 0.6.49-2 [320 kB
Get: 3 http://ftp.es.debian.org/debian/ jessie/main python-pip all 1.4.1-2 [266 kB
Fetched 648 kB in 2s (223 kB/s)
Selecting previously unselected package python-pkg-resources.
(Reading database ... 156790 files and directories currently installed.)
Unpacking python-pkg-resources (from .../python-pkg-resources_0.6.49-2_all.deb) ...
Selecting previously unselected package python-setuptools.
Unpacking python-setuptools (from .../python-setuptools_0.6.49-2_all.deb) ...
Selecting previously unselected package python-pip.
Unpacking python-pip (from .../python-pip_1.4.1-2_all.deb) ...
Processing triggers for man-db ...
Setting up python-pkg-resources (0.6.49-2) ...
Setting up python-setuptools (0.6.49-2) ...
Setting up python-pip (1.4.1-2) ...
[328] root@eva:~# easy_install selenium
Searching for selenium
Reading http://pypi.python.org/simple/selenium/
Best match: selenium 2.37.2
Downloading https://pypi.python.org/packages/source/s/selenium/selenium-2.37.2.tar.gz#md5=f3fffaae0bc789676c4e2ab285f7b04f
Processing selenium-2.37.2.tar.gz
Writing /tmp/easy_install-shFcgY/selenium-2.37.2/setup.cfg
Running selenium-2.37.2/setup.py -q bdist_egg --dist-dir /tmp/easy_install-shFcgY/selenium-2.37.2/egg-dist-tmp-_CdLcZ
Adding selenium 2.37.2 to easy-install.pth file
Installed /usr/local/lib/python2.7/dist-packages/selenium-2.37.2-py2.7.egg
Processing dependencies for selenium
Finished processing dependencies for selenium

Mac

Download and install python from python.org

Then install selenium using pip:

[502] rael@mbw:~$ sudo pip install selenium
Downloading/unpacking selenium
Downloading selenium-2.37.2.tar.gz (2.6MB): 2.6MB downloaded
Running setup.py egg_info for package selenium
Installing collected packages: selenium
Running setup.py install for selenium
Successfully installed selenium
Cleaning up...

Windows

Not tested yet, but I guess similar as in Mac.

Usage

Command interface

./gtav_crew_exporter.py --help
gtav_crew_exporter.py -c <crew_name> [-u <username> -p <password>] [-o <output_file>] [-v]

Flag	Description
–help	View the basic usage
-c, –crew	The name of the crew to export
-u, –username=	The username of your Rockstar social club
-p, –password=	The password of your Rockstar social club
-v	Verbose mode, for debug.

Examples

Only members and ranks

gtav_crew_exporter.py -c elotrolado

$ ./gtav_crew_exporter.py -c elotrolado
Crew: elotrolado
Crew Size: 300 members
!! Without login and password, only username and rank are available:
Crew Members :
leader, nihael, http://socialclub.rockstargames.com/member/nihael
commissioner, FJTR23, http://socialclub.rockstargames.com/member/fjtr23
lieutenant, Racso25, http://socialclub.rockstargames.com/member/racso25
representative, AntonLaveyX, http://socialclub.rockstargames.com/member/antonlaveyx
representative, beerna, http://socialclub.rockstargames.com/member/beerna
representative, lierhoff, http://socialclub.rockstargames.com/member/lierhoff
representative, raelga, http://socialclub.rockstargames.com/member/raelga
representative, rubi7410, http://socialclub.rockstargames.com/member/rubi7410
representative, Sd-Snatcher, http://socialclub.rockstargames.com/member/sd-snatcher
muscle, _XiloX_, http://socialclub.rockstargames.com/member/_xilox_
muscle, 4LUFLiNT, http://socialclub.rockstargames.com/member/4luflint
muscle, A_Rebato, http://socialclub.rockstargames.com/member/a_rebato

gtav_crew_exporter.py -c the_pollasos -u raelga -p ***

$ ./gtav_crew_exporter.py -c the_pollasos -u raelga -p ***
Crew: the_pollasos
Crew Size: 9 members
adrianrgvez, Spain, , PS3, the_pollasos, leader, 108, 5D 4H 17M, All ok.
corderius10, Spain, , PS3, the_pollasos, commissioner, 79, 78H 42M 24S, All ok.
oscartc14, Spain, , PS3, the_pollasos, lieutenant, 11, 8H 34M 36S, All ok.
alfi_de_pumarin9, Spain, , PS3, the_pollasos, representative, 24, 17H 23M 9S, All ok.
capableuncle3020, , , , , representative, , , Private profile.
rodri799, Spain, , PS3, the_pollasos, representative, 12, 14H 47M 50S, All ok.
yex_gr, Spain, yex_, PS3, the_pollasos, representative, 21, 24H 50M 26S, All ok.
OrignalBEAST, United Kingdom, ORIGNALBEASSTT, PS3, lossantosdiamondz, muscle, 24, 48H 40M 23S, All ok.
raelga, Spain, raelga, PS3, elotrolado, muscle, 65, 6D 13H 53M, All ok.

Verbose mode

gtav_crew_exporter.py -c the_pollasos -u raelga -p *** -v

$ ./gtav_crew_exporter.py -v -c the_pollasos -u raelga -p ***
Crew: the_pollasos
DBG : web - starting browser
DBG : web - page fully loaded!
DBG : web - set page in english.
DBG : web - all users visible.
Crew Size: 9 members
DBG : web - page fully loaded!
DBG : web - page fully loaded!
DBG : [adrianrgvez]
DBG : web - page fully loaded!
DBG : [adrianrgvez] main crew: the_pollasos
DBG : [adrianrgvez] PSN ID:
DBG : [adrianrgvez] country: Spain
DBG : web - page fully loaded!
DBG : [adrianrgvez] rank: leader
DBG : [adrianrgvez] playtime: 5D 4H 20M
DBG : [corderius10]
DBG : web - page fully loaded!
DBG : [corderius10] main crew: the_pollasos
DBG : [corderius10] PSN ID:
DBG : [corderius10] country: Spain
DBG : web - page fully loaded!
DBG : [corderius10] rank: commissioner
DBG : [corderius10] playtime: 78H 42M 24S
DBG : [oscartc14]
DBG : web - page fully loaded!
DBG : [oscartc14] main crew: the_pollasos
DBG : [oscartc14] PSN ID:
DBG : [oscartc14] country: Spain
DBG : web - page fully loaded!
DBG : [oscartc14] rank: lieutenant
DBG : [oscartc14] playtime: 8H 34M 36S
DBG : [alfi_de_pumarin9]
DBG : web - page fully loaded!
DBG : [alfi_de_pumarin9] main crew: the_pollasos
DBG : [alfi_de_pumarin9] PSN ID:
DBG : [alfi_de_pumarin9] country: Spain
DBG : web - page fully loaded!
DBG : [alfi_de_pumarin9] rank: representative
DBG : [alfi_de_pumarin9] playtime: 17H 23M 9S
DBG : [capableuncle3020]
DBG : web - page fully loaded!
DBG : [capableuncle3020] Profile is private!
DBG : [rodri799]
DBG : web - page fully loaded!
DBG : [rodri799] main crew: the_pollasos
DBG : [rodri799] PSN ID:
DBG : [rodri799] country: Spain
DBG : web - page fully loaded!
DBG : [rodri799] rank: representative
DBG : [rodri799] playtime: 14H 47M 50S
DBG : [yex_gr]
DBG : web - page fully loaded!
DBG : [yex_gr] main crew: the_pollasos
DBG : [yex_gr] PSN ID: ***
DBG : [yex_gr] country: Spain
DBG : web - page fully loaded!
DBG : [yex_gr] rank: representative
DBG : [yex_gr] playtime: 24H 50M 26S
DBG : [OrignalBEAST]
DBG : web - page fully loaded!
DBG : [OrignalBEAST] main crew: lossantosdiamondz
DBG : [OrignalBEAST] PSN ID: ***
DBG : [OrignalBEAST] country: United Kingdom
DBG : web - page fully loaded!
DBG : [OrignalBEAST] rank: muscle
DBG : [OrignalBEAST] playtime: 48H 40M 23S
DBG : [raelga]
DBG : web - page fully loaded!
DBG : [raelga] main crew: elotrolado
DBG : [raelga] PSN ID: raelga
DBG : [raelga] country: Spain
DBG : web - page fully loaded!
DBG : [raelga] rank: muscle
DBG : [raelga] playtime: 6D 13H 53M
adrianrgvez, Spain, , PS3, the_pollasos, leader, 108, 5D 4H 20M, All ok.
corderius10, Spain, , PS3, the_pollasos, commissioner, 79, 78H 42M 24S, All ok.
oscartc14, Spain, , PS3, the_pollasos, lieutenant, 11, 8H 34M 36S, All ok.
alfi_de_pumarin9, Spain, , PS3, the_pollasos, representative, 24, 17H 23M 9S, All ok.
capableuncle3020, , , , , representative, , , Private profile.
rodri799, Spain, , PS3, the_pollasos, representative, 12, 14H 47M 50S, All ok.
yex_gr, Spain, ****, PS3, the_pollasos, representative, 21, 24H 50M 26S, All ok.
OrignalBEAST, United Kingdom, ****, PS3, lossantosdiamondz, muscle, 24, 48H 40M 23S, All ok.
raelga, Spain, raelga, PS3, elotrolado, muscle, 65, 6D 13H 53M, All ok.