3870 Commits

Author SHA1 Message Date
Hans-Christoph Steiner
74c60bb4c9 throw in extra test URLs for HttpDownloaderTest
These are commented out so that the tests aren't brittle when they run on
the CI builds.  But are easy to uncomment when testing locally.
2016-10-25 11:54:40 +03:30
Hans-Christoph Steiner
ba9f9af76f support TLS 1.2 on all repos
Update to the latest NetCipher, which now fully supports SNI, in order to
support TLS 1.2 on all supported platform levels.  Without this, a repo
that is TLS 1.2 only will be unusable on all but the most recent versions
of Android.

#431
2016-10-25 11:54:40 +03:30
Hans-Christoph Steiner
d281d3f853 move HttpDownloaderTest to emulator, AndroidOS has oddities
There are oddities with the way that Android has implemented the network
stack, as compared to OpenJDK or Oracle JDK.  So running the tests on the
local JVM, i.e. Robolectric, will not provide good test coverage for real
world use cases.
2016-10-25 11:54:40 +03:30
Hans-Christoph Steiner
d8a0563ac0 update changelog for 0.101 2016-10-25 11:54:40 +03:30
Hans-Christoph Steiner
9f08be0c7d update to latest support lib bugfix version: v24.2.1 2016-10-25 11:54:40 +03:30
Hans-Christoph Steiner
4ae8bb3804 gitlab-ci: ensure the SDK is fully updated before running
This makes sure that the latest version of the core SDK components are
all current before running, which means that the builds will keep
working even when the docker image gets out of date. Then we can
finish the task we are working on before having to deal with updating
the docker image. Without that update line, we have to drop everything
and update the docker image when things are out of date.

Disk space and bandwidth is cheap, developer time is very scarce. We
should aim to keep the tests working as much as possible so that we
waste less developer time. Updating everytime only means it downloads
a little bit of XML each time, that's nothing compared to what gradle
downloads on every build.
2016-10-25 11:54:40 +03:30
Hans-Christoph Steiner
6e03fb7a2c gitlab-ci: use before and after script for reused chunks
It also reduces redundancy by using before_script and after_script blocks.
2016-10-25 11:54:40 +03:30
Hans-Christoph Steiner
eeb1ae24a0 gitlab-ci: reduce connected10 from error to warning
connected10 is still flaky since the emulator crashes a lot.  Marking it
for "allow_failure" will still show a warning, but it won't fail the build.
2016-10-25 11:54:40 +03:30
Daniel Martí
a214f8aa06 Add Icelandic to the list of languages
Added to weblate in the last commit.
2016-10-25 11:54:40 +03:30
F-Droid Translatebot
8cbc3c7557 Pull translation updates from Weblate
Translators:

Ajeje Brazorf       Sardinian
Enol P              Asturian
Marian Hanzel       Slovak
Michael Moroni      Italian
Mladen Pejaković    Serbian
Sérgio Marques      Portuguese (Portugal)
Sveinn í Felli      Icelandic
Дмитрий Михирев     Russian
2016-10-25 11:54:40 +03:30
Felix Ableitner
c5fa6d94c7 Fixed link to privileged extension 2016-10-25 11:54:40 +03:30
Peter Serwylo
f61fa0c4f8 More robust fix for #763, specifying column names to copy explicitly.
This is far less brittle at runtime, but slightly more work at dev time.
The following things are undesirable but make it much easier to write:
 * Use of `CREATE_TABLE_APP.replaceFirst(...)` to create the temp tables.
 * Having to specify a list fo columns twice in `Schema` (`ALL_COLS` + `COLS`).

The `replaceFirst` means we don't need to maintain two separate create table
statements. It is a little messy because there is no compile time guarantee
that we are creating a valid SQL statement at the end, just our knowledge
that a create table statment tends to have the table name first and it
probably wont cause problems.

The `ALL_COLS` + `COLS` is required so that we don't have to type out a list
of fields when copying data in `TempAppProvider`. Otherwise, whenever a new
column is added, developers would need to know that it also needs to be added
to this third place. Currently it is in the `Schema` and the `CREATE_TABLE_*`
statements where one needs to add a new column. These are both intuitive and
hopefully easily discoverable. Having to add it to the `TempAppProvider` is
less intuitive and likely to result in bugs.
2016-10-25 11:54:40 +03:30
Peter Serwylo
4aad2f865d Fixed issue #763 by being more specific when creating temp table for update.
When performing the old style `CREATE TABLE ... AS SELECT ...` (CTAS) statement,
no indexes are added. In addition, rowid is not added. Even if manually
specifying an autoincrement column in the original schema, this autoincrement
column does not get recreated with the CTAS statement. So instead, this change
reuses the original `CREATE TABLE` statement which explicitly defines all of the
relevant columns. In addition, it explicitly adds an autoincrement integer primary
key. This has the same semantics as the existing implicit `rowid` column that
sqlite creates. From from https://sqlite.org/autoinc.html:

> In SQLite, a column with type INTEGER PRIMARY KEY is an alias for the ROWID
> (except in WITHOUT ROWID tables) which is always a 64-bit signed integer.

However, as it is explicit now, is copied when doing the
`INSERT INTO ... SELECT ...` statement to get data from the real table to the
temp table in preperation for updates (and back again after the update has
populated the temp table).

Note that this makes the `INSERT INTO ... SELECT ...` statements slightly more
brittle, because now we need the table definition used to create the temp table
(from `DBHelper.CREATE_APP_TABLE`) to have the same column order as those in the
real `fdroid_app` table. While this may sound like a silly comment to make, it
is important because database migrations can result in a database having the
correct set of columns, but in a different order to how they were specified
in the original create table statement.

If a database migration performs an `ALTER TABLE ... ADD COLUMN ...` the column
will be added at the end. If at the same time the `CREATE TABLE` is changed so
that the new column is specified as the second to last column in the list of
columns, then the `INSERT INTO ... SELECT ...` will not work as expected.
2016-10-25 11:54:40 +03:30
Peter Serwylo
4bb183aa61 Use database constant instead of hard coded string literal 2016-10-25 11:54:40 +03:30
Peter Serwylo
75ee202bb9 Replicated issue #763 in a test case 2016-10-25 11:54:40 +03:30
Hans-Christoph Steiner
9b61dfdcb4 fix emulator tests on android-10, closes #769
We have to work harder to get writeable dirs in the android-10 emulator.
2016-10-25 11:54:40 +03:30
uberspot
a183da42b6 Remove any whitespace from fingerprint EditText input so that copy pasting is easier for users. 2016-10-25 11:54:40 +03:30
Daniel Martí
6844b31884 Bump build-tools and docker image version
The latter is simply to include the newer version.
2016-10-25 11:54:40 +03:30
Daniel Martí
6ba260b07b Add new Burmese/Myanmar language to the list
Rendering this on my computer is a pain, so patches welcome if I screwed
up the unicode since all I can see is squares.
2016-10-25 11:54:40 +03:30
F-Droid Translatebot
977f0fe747 Pull translation updates from Weblate
Translators:

Agus                      Galician
Ajeje Brazorf             Sardinian
Alberto Moshpirit         Spanish
El Virolo                 French
Koen Glotzbach            Dutch
Licaon Kter               Romanian
Michael                   German
Mohamad Hasan Al Banna    Indonesian
naofum                    Japanese
Olexandr Nesterenko       Ukrainian
Osoitz                    Basque
Pyae Sone                 Burmese
Verdulo                   Esperanto
Verdulo                   Polish
YFdyh000                  Simplified Chinese
2016-10-25 11:54:40 +03:30
F-Droid Translatebot
0133854ad6 Pull translation updates from Weblate
Translators:

Adrià García-Alzórriz    Catalan
Ajeje Brazorf            Sardinian
Christophe CHAUVET       French
Enol P                   Asturian
Laura Arjona Reina       Spanish
Licaon Kter              Romanian
Michael                  German
Mladen Pejaković         Serbian
naofum                   Japanese
Osoitz                   Basque
Swyter                   Spanish
Sylvia van Os            Dutch
Tobias Bannert           German
Verdulo                  Esperanto
Verdulo                  Polish
Viktor Alojzije Coric    Croatian
Waqar Ahmed              Urdu
YFdyh000                 Simplified Chinese
2016-10-25 11:54:40 +03:30
Hans-Christoph Steiner
1e26e31309 privileged mode means auto-downloads are actually installs
When the Privileged Extension is working, then enabling the preference
"Automatically download updates" will actually install those updates in the
background.  So the preference should communicate that to the user. So now
it serves as a global "allow background updates"

#16
closes #106
2016-10-25 11:54:40 +03:30
Hans-Christoph Steiner
4b922f38b9 don't show notification if the app name is unknown #720
This gets rid of the notifications that say "Tap to Install Unknown", and
instead just cancels the notification.  The downloaded APK will still be
cached, so when the user goes to click install or update again, it won't
need to download it again.

closes #758
2016-10-25 11:54:40 +03:30
Hans-Christoph Steiner
5b46303961 handle install broadcasts after InstallManagerService was killed
If InstallManagerService was killed, it'll forget all of its state.  If it
is killed while an install process is running, and that install fails,
InstallManagerService will receive a broadcast about the error but then it
can't find anything about the app in question besides its download URL.
That is enough to control the notification, but not enough to get the name
of the app in question.  This is a workaround by showing the APK filename
when the app name cannot be found. Ideally, the packageName would somehow
magically be delivered to InstallManagerService in this case, but the
Installer stuff doesn't always have it to send.

With android-23, there is getActiveNotifications(), which we might be able
to use to stash the packageName and fetch it as needed.
2016-10-25 11:54:40 +03:30
Aditya Bharadwaj
9ca20395be Fix PMD issue. 2016-10-25 11:54:40 +03:30
Aditya Bharadwaj
1688adc0d4 Update naming convention as per review. Add antifeatures list length check to filter anti-feature apps. 2016-10-25 11:54:40 +03:30
Aditya Bharadwaj
7997e707d8 Fix checkstyle issue. 2016-10-25 11:54:40 +03:30
Aditya Bharadwaj
6e90be7b68 Add option to grey out apps requiring anti-features. 2016-10-25 11:54:40 +03:30
Daniel Martí
81b0eacd9f Bump to 0.101-alpha6 2016-10-25 11:54:40 +03:30
F-Droid Translatebot
ba26228dce Pull translation updates from Weblate
Translators:

Ajeje Brazorf    Sardinian
John Doe         Turkish
Nathan Follens   Dutch
2016-10-25 11:54:40 +03:30
Hans-Christoph Steiner
8d8400449e get ACRA reports without crashing to debug #698
This should be reverted once #698 is fixed.  If execution has gotten this
far into InstallManagerService, there should always be App and Apk
instances.  That is enforced when Intents are received by this Service.
2016-10-25 11:54:40 +03:30
Hans-Christoph Steiner
1d5dcb76a2 remove confusing messages when Privileged Extension not installed
This was saying that the Privileged Extension is enabled but not properly
configured.  This is because the preference logic changed to default to on
unless the user explicitly disabled it.  So using the Privileged
Extension based on whether its installed and whether the user has disabled
it.

related to ea0700d406101b7ed6907b1dbd2918dbc214f435
2016-10-25 11:54:40 +03:30
Hans-Christoph Steiner
2d25ef53f5 update support libs to latest (24.2.0) to hopefully fix crashes
Based on ACRA reports, there are some mystery UI related stacktraces that
do not have org.fdroid.fdroid lines in them.
2016-10-25 11:54:40 +03:30
Hans-Christoph Steiner
f888d9e5fc use gradle-witness for all included libs
use the automatic method for generating the gradle-witness block so its
easy to keep it updated.
2016-10-25 11:54:40 +03:30
Hans-Christoph Steiner
ce928e40fa sort gradle-witness lines so its easy to see changes 2016-10-25 11:54:40 +03:30
Hans-Christoph Steiner
9db47da42b check whether installed APKs exist and are readable before hashing
I guess APKs could disappear, or perhaps not be readable.

closes #699

Here's the stacktrace:

java.io.FileNotFoundException:
 /system/priv-app/ATT_Ready2Go/ATT_Ready2Go.apk: open failed: ENOENT (No such file or directory)
 at org.fdroid.fdroid.Utils.getBinaryHash(Utils.java:405)
 at org.fdroid.fdroid.data.InstalledAppProviderService.onHandleIntent(InstalledAppProviderService.java:164)
 at android.app.IntentService$ServiceHandler.handleMessage(IntentService.java:65)
 at android.os.Handler.dispatchMessage(Handler.java:102)
 at android.os.Looper.loop(Looper.java:135)
 at android.os.HandlerThread.run(HandlerThread.java:61)
2016-10-25 11:54:40 +03:30
Hans-Christoph Steiner
5c18cead1c update changelog
closes #752
2016-10-25 11:54:40 +03:30
Hans-Christoph Steiner
e65706971e use Privileged Extension by default when it is installed
This totally changed the logic of the "Use Privileged Extension" preference
making it based on whether the Privileged Extension is installed and usable
rather than storing the user's selection.  This code now only stores when
the user manually disables using the Privileged Extension even when it is
installed.

closes #729
2016-10-25 11:54:40 +03:30
Hans-Christoph Steiner
9b07167430 only show "install Priv Ext" in Prefs when its supported
The root install method that is available via the "Expert" preferences does
not work on newer than android-19.  So when that's the case, this hides
that item from the preferences screen entirely.
2016-10-25 11:54:40 +03:30
Hans-Christoph Steiner
010574c0ce gitlab-ci: require emulator tests pass on android-24 2016-10-25 11:54:40 +03:30
Hans-Christoph Steiner
2158afcc9d fix bug in cache cleanup on 21+ introduced in cbd6da5
!379 was merged without the emulator tests passing.  This fixes that.
2016-10-25 11:54:40 +03:30
Daniel Martí
8a1a2fa310 Bump robolectric to 3.1.2 2016-10-25 11:54:40 +03:30
Daniel Martí
a0b56b23ca gradle: bump plugin and wrapper version
Since the new plugin requires 2.14.1 for security reasons.

Also re-run `gradle wrapper` to update the scripts and the jar.
2016-10-25 11:54:40 +03:30
Daniel Martí
3a1c6612c0 CI: bump image 2016-10-25 11:54:40 +03:30
Daniel Martí
f26768a77c Bump to 0.101-alpha5 2016-10-25 11:54:40 +03:30
F-Droid Translatebot
6b89201d93 Pull translation updates from Weblate
Translators:

Kristjan Räts    Estonian
Marko            Finnish
tacsipacsi       Hungarian
2016-10-25 11:54:40 +03:30
Peter Serwylo
c76c920397 Move code causing verify error into separate helper class
I'm not 100% sure on how the `@TargetApi` and `VerifyError` work
together. However it is something along the lines of:
 * Class loader needs `CleanCacheService`.
 * At this point, it loads the bytecode for that class and verifies
   that it all makes sense.
 * The bytecode within the method targeted at API 21 is not understood
   by earlier APIs, because the entire `Os` class was introduced in 21.
 * By putting it into a different class, that class is only loaded
   at runtime on devices with API of 21 or higher.

Previously, `@TargetApi` + the relevant guard condition to check
the build version at runtime suffices to prevent this. However it seems
that if the entire class does not even exist on earlier APIs, then it
is no longer good enough.
2016-10-25 11:54:40 +03:30
Peter Serwylo
c02cc41c2f Ensure that description is not null when parsing index.
At time of writing (and for some time before), fdroidserver has forced
a description of "No description available" for apps which don't have
descriptions at all:

 * https://gitlab.com/fdroid/fdroidserver/blob/0.6.0/fdroidserver/metadata.py#L876

However, if the description is not set for whatever reason, it should not
crash the client.
2016-10-25 11:54:40 +03:30
Hans-Christoph Steiner
fe35343a36 document processes in CleanCacheService
This breaks out each separate process into its own utility method, and adds
javadoc to describe them.
2016-10-25 11:54:40 +03:30
Hans-Christoph Steiner
3944747766 delete cached icons that have not been accessed in over a year
The icon files are downloaded for each version of the app.  Over time, old
versions will pile up.  This cleans out the ones that have not been used in
over a year.

On < android-21, this will delete icons that were downloaded over a year
ago even if they are still in use because it is only possible to check
mtime, not atime.
2016-10-25 11:54:40 +03:30