#March 2015

Docker, Linux

Install Scrapy Portia in Ubuntu Server 14.04

4

There are 2 ways to install Scrapy Portia in Ubuntu Server 14.04: Install via virtualenv/pip or Install Docker. Please see the details below

The key is not to prioritize what's on your schedule, but to schedule your priorities

The key is not to prioritize what’s on your schedule, but to schedule your priorities

Option 1: Install Portia via Virtualenv/pip

Please make sure that virtualenv and pip is ready to use in your server.

Do activate Portia environment:

1
2
virtualenv portia --no-site-packages
source portia/bin/activate

Download Protia source code:

1
2
cd portia/
git clone https://github.com/scrapinghub/portia.git

 

Install libraries, packets:

1
2
3
4
5
pip install -r requirements.txt
sudo pip install -r requirements.txt
pip install -e ./slybot
sudo apt-get install libxml2-dev libxslt-dev python-dev zlib1g-dev libffi-dev libssl-dev
pip install cryptography

Check  port 9001, and run Portia:

1
2
sudo lsof -i :9001
sudo twistd -n slyd

Test Portia at link: http://localhost:9001/static/main.html

Install Portia via Docker (recommended):

Make sure that Docker was installed in your server and ready to use:

Download source code:

1
2
git clone https://github.com/scrapinghub/portia
cd portia/

Build Portia Image:

1
2
docker build -t portia .
sudo docker build -t portia .

And run Protia Docker container:

1
2
3
docker run -i -t --rm
-v <PROJECT_FOLDER>/data:/app/slyd/data:rw -p 9001:9001 --name portia portia
-v data:/app/slyd/data:rw -p 9001:9001 --name portia portia

Nguyen Sy Thanh Son

4

PHP

How to integrate phpCAS in Laravel

6

I would like to share you how to integrate phpCAS in Laravel. As you know, Jasig CAS is a Single-Sign-On System. If you want to connect to Jasig CAS from your system (that is wrote by PHP), you use phpCAS Library

Work hard in Silence, Let Success make the noise

Work hard in Silence, Let Success make the noise

To know how to install a Jasig CAS server, please see:  https://sonnguyen.ws/install-jasig-cas-ubuntu-14-04/

Step 1:  Download phpCAS Library and locate it in app/library directory

1
2
cd app/library
git clone https://github.com/Jasig/phpCAS.git

Step 2: Create CAS Authentication Provider

We create file CasAuthProvider.php

1
2
3
mkdir app/cas
cd app/cas
vi CasAuthProvider.php

Add source code to file:

1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
<?php namespace cas;
 
use Illuminate\Auth\GenericUser;
use Illuminate\Auth\UserInterface;
use Illuminate\Auth\UserProviderInterface;
 
class CasAuthProvider implements UserProviderInterface
{
    /**
     * Retrieve a user by their unique identifier.
     *
     * @param  mixed  $id
     * @return \Illuminate\Auth\UserInterface|null
     */
    public function retrieveById($id)
    {
        return $this->casUser();
    }
 
    /**
     * Retrieve a user by the given credentials.
     *
     * @param  array  $credentials
     * @return \Illuminate\Auth\UserInterface|null
     */
    public function retrieveByCredentials(array $credentials)
    {
        return $this->casUser();
    }
 
    /**
     * Validate a user against the given credentials.
     *
     * @param  \Illuminate\Auth\UserInterface  $user
     * @param  array  $credentials
     * @return bool
     */
    public function validateCredentials(UserInterface $user, array $credentials)
    {
        return true;
    }
 
    protected function casUser()
    {
        $cas_host = \Config::get('app.cas_host');
        $cas_context = \Config::get('app.cas_context');
        $cas_port = \Config::get('app.cas_port');
        \phpCAS::setDebug();
        \phpCAS::client(CAS_VERSION_2_0, $cas_host, $cas_port, $cas_context);
        \phpCAS::setNoCasServerValidation();
 
        if (\phpCAS::isAuthenticated())
        {
            $attributes = array(
                'id' => \phpCAS::getUser(),
                'name' => \phpCAS::getUser()
            );
            return new GenericUser($attributes);
        }
        else
        {
            \phpCAS::setServerURL(\Config::get('app.url'));
            \phpCAS::forceAuthentication();
        }
        return null;
    }
 
    /**
     * Needed by Laravel 4.1.26 and above
     */
    public function retrieveByToken($identifier, $token)
    {
        return new \Exception('not implemented');
    }
 
    /**
     * Needed by Laravel 4.1.26 and above
     */
    public function updateRememberToken(UserInterface $user, $token)
    {
        return new \Exception('not implemented');
    }
}
?>

Please make note that, you have to add  cas_host, cas_context, cas_port to app/config/app.php file

Step 3: Adding new provider to Laravel

Edit app/start/global.php file by adding code:

1
2
3
4
Auth::extend('cas', function($app)
{
    return new cas\CasAuthProvider;
});

Step 4: Adding phpCAS library, new provider to Laravel Autoload

Open composer.json located at Laravel Root Directory and add app/library/phpCAS, app/cas:

1
2
3
4
5
6
7
8
9
10
11
12
13
    "autoload": {
        "classmap": [
            "app/commands",
            "app/controllers",
            "app/models",
            "app/library",
            "app/library/phpCAS",
            "app/cas",
            "app/database/migrations",
            "app/database/seeds",
            "app/tests/TestCase.php"
        ]
    },

Dump new Laravel Autoload file:

1
php artisan dump-autoload

Step 5: Finally, create route and controller for login action

In app/routes.php file add:

1
2
Route::get('/login', array('as' => 'login', 'uses' => 'Admin@login'));
Route::post('/login', array('as' => 'login', 'uses' => 'Admin@login'));

In app/controllers/Admin.php add:

1
2
3
4
5
6
7
8
9
10
11
12
13
14
    function login()
    {
        $message_error = "";
        if(Auth::check())
            // Redirect to link after login
        else
        {
            if (Auth::attempt(array()))
            {
                // Redirect to link after login
            }
            // Redirect to un-logged in page
        }
    }

 

 

Nguyen Sy Thanh Son

6

PHP

Adding external library to Laravel 4+

1

When you work with a framework, sometimes you need to use an external library. This will show you the way to add an external library to Laravel 4. Actually, it is very simple.

For example, you have a library that locates in path: app/library/external_lib. So you should add that path to composer.json file (located at root directory of framework)

1
2
3
4
5
6
7
8
9
10
11
12
    "autoload": {
        "classmap": [
            "app/commands",
            "app/controllers",
            "app/models",
            "app/library",
            "app/library/external_lib",
            "app/database/migrations",
            "app/database/seeds",
            "app/tests/TestCase.php"
        ]
    },

The next step is the final step, run command to dump library to autoload file of framework.

1
composer dump-autoload

I assumed that composer was installed to your machine.

Nguyen Sy Thanh Son

1